The migration of tasks aided by machine learning(ML)predictions IN(DPM)is a system-level design technique that is used to reduce energy by enhancing the overall performance of the processor.In this paper,we address th...The migration of tasks aided by machine learning(ML)predictions IN(DPM)is a system-level design technique that is used to reduce energy by enhancing the overall performance of the processor.In this paper,we address the issue of system-level higher task dissipation during the execution of parallel workloads with common deadlines by introducing a machine learning-based framework that includes task migration using energy-efficient earliest deadline first scheduling(EA-EDF).ML-based EA-EDF enhances the overall throughput and optimizes the energy to avoid delay and performance degradation in a multiprocessor system.The proposed system model allocates processors to the ready task set in such a way that their deadlines are guaranteed.A full task migration policy is also integrated to ensure proper task mapping that ensures inter-process linkage among the arrived tasks with the same deadlines.The execution of a task can halt on one CPU and reschedule the execution on a different processor to avoid delay and ensure meeting the deadline.Our approach shows promising potential for machine-learning-based schedulability analysis enables a comparison between different ML models and shows a promising reduction in energy as compared with other ML-aware task migration techniques for SoC like Multi-Layer Feed-Forward Neural Networks(MLFNN)based on convolutional neural network(CNN),Random Forest(RF)and Deep learning(DL)algorithm.The Simulations are conducted using super pipelined microarchitecture of advanced micro devices(AMD)XScale PXA270 using instruction and data cache per core 32 Kbyte I-cache and 32 Kbyte D-cache on various utilization factors(ui)12%,31%and 50%.The proposed approach consumes 5.3%less energy when almost half of the CPU is running and on a lower workload consumes 1.04%less energy.The proposed design accumulatively gives significant improvements by reducing the energy dissipation on three clock rates by 4.41%,on 624 MHz by 5.4%and 5.9%on applications operating on 416 and 312 MHz standard operating frequencies.展开更多
With the emphasis on user privacy and communication security, encrypted traffic has increased dramatically, which brings great challenges to traffic classification. The classification method of encrypted traffic based...With the emphasis on user privacy and communication security, encrypted traffic has increased dramatically, which brings great challenges to traffic classification. The classification method of encrypted traffic based on GNN can deal with encrypted traffic well. However, existing GNN-based approaches ignore the relationship between client or server packets. In this paper, we design a network traffic topology based on GCN, called Flow Mapping Graph (FMG). FMG establishes sequential edges between vertexes by the arrival order of packets and establishes jump-order edges between vertexes by connecting packets in different bursts with the same direction. It not only reflects the time characteristics of the packet but also strengthens the relationship between the client or server packets. According to FMG, a Traffic Mapping Classification model (TMC-GCN) is designed, which can automatically capture and learn the characteristics and structure information of the top vertex in FMG. The TMC-GCN model is used to classify the encrypted traffic. The encryption stream classification problem is transformed into a graph classification problem, which can effectively deal with data from different data sources and application scenarios. By comparing the performance of TMC-GCN with other classical models in four public datasets, including CICIOT2023, ISCXVPN2016, CICAAGM2017, and GraphDapp, the effectiveness of the FMG algorithm is verified. The experimental results show that the accuracy rate of the TMC-GCN model is 96.13%, the recall rate is 95.04%, and the F1 rate is 94.54%.展开更多
The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combinatio...The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.展开更多
Knowledge of pore-water pressure(PWP)variation is fundamental for slope stability.A precise prediction of PWP is difficult due to complex physical mechanisms and in situ natural variability.To explore the applicabilit...Knowledge of pore-water pressure(PWP)variation is fundamental for slope stability.A precise prediction of PWP is difficult due to complex physical mechanisms and in situ natural variability.To explore the applicability and advantages of recurrent neural networks(RNNs)on PWP prediction,three variants of RNNs,i.e.,standard RNN,long short-term memory(LSTM)and gated recurrent unit(GRU)are adopted and compared with a traditional static artificial neural network(ANN),i.e.,multi-layer perceptron(MLP).Measurements of rainfall and PWP of representative piezometers from a fully instrumented natural slope in Hong Kong are used to establish the prediction models.The coefficient of determination(R^2)and root mean square error(RMSE)are used for model evaluations.The influence of input time series length on the model performance is investigated.The results reveal that MLP can provide acceptable performance but is not robust.The uncertainty bounds of RMSE of the MLP model range from 0.24 kPa to 1.12 k Pa for the selected two piezometers.The standard RNN can perform better but the robustness is slightly affected when there are significant time lags between PWP changes and rainfall.The GRU and LSTM models can provide more precise and robust predictions than the standard RNN.The effects of the hidden layer structure and the dropout technique are investigated.The single-layer GRU is accurate enough for PWP prediction,whereas a double-layer GRU brings extra time cost with little accuracy improvement.The dropout technique is essential to overfitting prevention and improvement of accuracy.展开更多
A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their...A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their spatial distributions.Multi-layer perceptron neural networks(MLP-NNs)are commonly used for classification.Training such MLP-NNs has great importance in a way that has attracted many researchers to this field recently.Conventional methods for training NNs,such as gradient descent and recursive methods,have some disadvantages including low accuracy,slow convergence speed and trapping in local minimums.In this paper,in order to overcome these issues,the MLP-NN trained by a hybrid population-physics-based algorithm,the combination of particle swarm optimization and gravitational search algorithm(PSOGSA),is proposed for our classification problem.To show the advantages of using PSOGSA that trains NNs,this algorithm is compared with other meta-heuristic algorithms such as particle swarm optimization(PSO),gravitational search algorithm(GSA)and new versions of PSO.The metrics that are discussed in this paper are the speed of convergence and classification accuracy metrics.The results show that the proposed algorithm in most subjects of encephalography(EEG)dataset has very better or acceptable performance compared to others.展开更多
Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper descri...Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.展开更多
High rigidity twenty-high Sendzimir mills (ZRMs) are widely used for rolling stainless steels, silicon sheets, etc. A ZRM uses a small diameter work roll to produce massive rolling forces. Since a work roll with a s...High rigidity twenty-high Sendzimir mills (ZRMs) are widely used for rolling stainless steels, silicon sheets, etc. A ZRM uses a small diameter work roll to produce massive rolling forces. Since a work roll with a small diameter can be bent easily, strips often have complex shapes with mixed quarter and deep edge waves in the shape of plates. In order to solve this problem, fuzzy neural network controls are generally used for shape: recognition in ZRM control systems. Among various neural network types, the multi-layer perceptron (MLP) is typically used in current ZRMs. However, an MLP causes the loss of a large amount of shape recognition data. To improve the shape recognition per- formance of ZRM control systems, echo state networks (ESNs) are proposed to be used. Through simulation re- sults, it is found that shape recognition performance could be improved using the proposed ESN method.展开更多
The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabi...The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabilized confined jet diffusion flames in the presence of different geometries of bluff-body burners. Two stabilizer disc burners tapered at 30° and 60° and another frustum cone of 60°/30° inclination angle were employed all having the same diameter of 80 (mm) acting as flame holders. The measured radial mean temperature profiles of the developed stabilized flames at different normalized axial distances (x/dj) were considered as the model example of the physical process. The RSM and ANN methods analyze the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x/dj) on the measured temperature of the flames, to find the predicted maximum temperature and the corresponding process variables. A three-layered Feed Forward Neural Network in conjugation with the hyperbolic tangent sigmoid (tansig) as transfer function and the optimized topology of 2:10:1 (input neurons: hidden neurons: output neurons) was developed. Also the ANN method has been employed to illustrate such effects in the three and two dimensions and shows the location of the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of R2 and F Ratio are 0.868 - 0.947 and 231.7 - 864.1 for RSM method compared to 0.964 - 0.987 and 2878.8 7580.7 for ANN method beside lower values for error analysis terms.展开更多
In addition to the effect that the COVID-19 pandemic has had on the physical and mental health of individuals,it has also led to a change in the mental and emotional state of many employees.Especially among businesses...In addition to the effect that the COVID-19 pandemic has had on the physical and mental health of individuals,it has also led to a change in the mental and emotional state of many employees.Especially among businesses and private companies,which faced many restrictions due to the special conditions of the pandemic.Therefore,the present study aimed to design an artificial neural network with MLP technique to analyze the relationship between demographic variables,resilience,COVID-19 and burnout in start-ups in Iran.The research method was quantitative.Managers and employees of start-ups formed the statistical population of the study,based on the statistical sample size of the unlimited community,384 of them were tested.For data gathering,standard questionnaires include of MBI-GS and BRCS and researcher-made questionnaire of stress caused by COVID-19 were used.The validity of the questionnaires was confirmed by a panel of experts and their reliability was confirmed by Cronbach’s alpha coefficient.The number of neurons in the input layer was equal to 10,the number of neurons in the 1st hidden layer was equal to 7,the number of neurons in the output layer was equal to 1,and the number of epochs was equal to 500.70%of the data were used for training and 30%for testing.In the designed artificial neural network,all experiment data except one were correctly predicted and the obtained MAE error was less than 0.012%.Finally,he precision and correction of the presented model was confirmed by the obtained results.展开更多
One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexi...One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP) with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion) faced when using the Inverse Geometric Models implementation (IGM) in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.展开更多
This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time seri...This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.展开更多
Biometric techniques require critical operations of digital processing for identification of individuals. In this context, this paper aims to develop a system for automatic processing of fingerprint identification by ...Biometric techniques require critical operations of digital processing for identification of individuals. In this context, this paper aims to develop a system for automatic processing of fingerprint identification by their minutiae using Artificial Neural Networks (ANN), which reveals to be highly effective. The ANN method implemented is a based on Multi-Layer Perceptron (MLP) model, which utilizes the algorithm of retro-propagation of gradient during the learning process. In such a process, the mean square error generated represents the specific parameter for the identification phase by comparing a fingerprint taken from a crime scene with those of a reference database.展开更多
In the context of new risks and threats associated to nuclear, biological and chemical (NBC) attacks, and given the shortcomings of certain analytical methods such as principal component analysis (PCA), a neural n...In the context of new risks and threats associated to nuclear, biological and chemical (NBC) attacks, and given the shortcomings of certain analytical methods such as principal component analysis (PCA), a neural network approach seems to be more accurate. PCA consists in projecting the spectrum of a gas collected from a remote sensing system in, firstly, a three-dimensional space, then in a two-dimensional one using a model of Multi-Layer Perceptron based neural network. It adopts during the learning process, the back propagation algorithm of the gradient, in which the mean square error output is continuously calculated and compared to the input until it reaches a minimal threshold value. This aims to correct the synaptic weights of the network. So, the Artificial Neural Network (ANN) tends to be more efficient in the classification process. This paper emphasizes the contribution of the ANN method in the spectral data processing, classification and identification and in addition, its fast convergence during the back propagation of the gradient.展开更多
Background:Diabetes and hypertension are two of the commonest diseases in the world.As they unfavorably affect people of different age groups,they have become a cause of concern and must be predicted and diagnosed wel...Background:Diabetes and hypertension are two of the commonest diseases in the world.As they unfavorably affect people of different age groups,they have become a cause of concern and must be predicted and diagnosed well in advance.Objective:This research aims to determine the effectiveness of artificial neural networks(ANNs)in predicting diabetes and blood pressure diseases and to point out the factors which have a high impact on these diseases.Sample:This work used two online datasets which consist of data collected from 768 individuals.We applied neural network algorithms to predict if the individuals have those two diseases based on some factors.Diabetes prediction is based on five factors:age,weight,fat-ratio,glucose,and insulin,while blood pressure prediction is based on six factors:age,weight,fat-ratio,blood pressure,alcohol,and smoking.Method:A model based on the Multi-Layer Perceptron Neural Network(MLP)was implemented.The inputs of the network were the factors for each disease,while the output was the prediction of the disease’s occurrence.The model performance was compared with other classifiers such as Support Vector Machine(SVM)and K-Nearest Neighbors(KNN).We used performance metrics measures to assess the accuracy and performance of MLP.Also,a tool was implemented to help diagnose the diseases and to understand the results.Result:The model predicted the two diseases with correct classification rate(CCR)of 77.6%for diabetes and 68.7%for hypertension.The results indicate that MLP correctly predicts the probability of being diseased or not,and the performance can be significantly increased compared with both SVM and KNN.This shows MLPs effectiveness in early disease prediction.展开更多
为解决现有算法在处理不同特征点云时存在普适性不足、效率低下、难以应用于工程实际的问题,提出一种基于神经网络的岩体结构面智能识别方法,具体包括4个步骤。首先,对原始点云进行标准化预处理操作,并人工选取具有代表性的特征区域,以...为解决现有算法在处理不同特征点云时存在普适性不足、效率低下、难以应用于工程实际的问题,提出一种基于神经网络的岩体结构面智能识别方法,具体包括4个步骤。首先,对原始点云进行标准化预处理操作,并人工选取具有代表性的特征区域,以构建高质量的训练样本集;其次,采用CFSFDP(clustering by fast search and find of density peaks)聚类算法为样本生成标签;再次,构建并训练多层感知机(multilayer perceptron,MLP)模型和多层卷积神经网络(multi-layer convolutional neural network,MCNN)模型,输入全尺度点云的点法向量进行结构面粗识别,并对2种模型进行比选分析;最后,使用HDBSCAN(hierarchical density-based spatial clustering of applications with noise)算法对分类结果进行细化与产状计算。结果表明:1)采用多层感知机模型处理简单结构面时具有较高的处理速度,而卷积神经网络模型在处理复杂、非均匀点云时展现出更高的分类精度。2)与聚类方法相比,该方法计算时间提升25%~50%,能够有效解决传统算法无法适用于不同复杂点云的问题,且具有很强的鲁棒性。展开更多
为进一步提高高光谱影像分类精度,通过引入Network In Network网络结构,构建了一种新的网络模型。该网络模型能够对局部感受野内的数据进行更加抽象的建模,从而能够对影像中的空谱联合特征进行更为抽象的表达。通过在Pavia University和...为进一步提高高光谱影像分类精度,通过引入Network In Network网络结构,构建了一种新的网络模型。该网络模型能够对局部感受野内的数据进行更加抽象的建模,从而能够对影像中的空谱联合特征进行更为抽象的表达。通过在Pavia University和Indian Pines两个数据集上进行验证,实验结果表明,所构建的网络模型能够有效提高分类精度,在减少训练样本的条件下仍具有较好的分类性能。展开更多
摘要The migration of tasks aided by machine learning(ML)predictions IN(DPM)is a system-level design technique that is used to reduce energy by enhancing the overall performance of the processor.In this paper,we address the issue of system-level higher task dissipation during the execution of parallel workloads with common deadlines by introducing a machine learning-based framework that includes task migration using energy-efficient earliest deadline first scheduling(EA-EDF).ML-based EA-EDF enhances the overall throughput and optimizes the energy to avoid delay and performance degradation in a multiprocessor system.The proposed system model allocates processors to the ready task set in such a way that their deadlines are guaranteed.A full task migration policy is also integrated to ensure proper task mapping that ensures inter-process linkage among the arrived tasks with the same deadlines.The execution of a task can halt on one CPU and reschedule the execution on a different processor to avoid delay and ensure meeting the deadline.Our approach shows promising potential for machine-learning-based schedulability analysis enables a comparison between different ML models and shows a promising reduction in energy as compared with other ML-aware task migration techniques for SoC like Multi-Layer Feed-Forward Neural Networks(MLFNN)based on convolutional neural network(CNN),Random Forest(RF)and Deep learning(DL)algorithm.The Simulations are conducted using super pipelined microarchitecture of advanced micro devices(AMD)XScale PXA270 using instruction and data cache per core 32 Kbyte I-cache and 32 Kbyte D-cache on various utilization factors(ui)12%,31%and 50%.The proposed approach consumes 5.3%less energy when almost half of the CPU is running and on a lower workload consumes 1.04%less energy.The proposed design accumulatively gives significant improvements by reducing the energy dissipation on three clock rates by 4.41%,on 624 MHz by 5.4%and 5.9%on applications operating on 416 and 312 MHz standard operating frequencies.
基金supported by the National Key Research and Development Program of China No.2023YFA1009500.
摘要With the emphasis on user privacy and communication security, encrypted traffic has increased dramatically, which brings great challenges to traffic classification. The classification method of encrypted traffic based on GNN can deal with encrypted traffic well. However, existing GNN-based approaches ignore the relationship between client or server packets. In this paper, we design a network traffic topology based on GCN, called Flow Mapping Graph (FMG). FMG establishes sequential edges between vertexes by the arrival order of packets and establishes jump-order edges between vertexes by connecting packets in different bursts with the same direction. It not only reflects the time characteristics of the packet but also strengthens the relationship between the client or server packets. According to FMG, a Traffic Mapping Classification model (TMC-GCN) is designed, which can automatically capture and learn the characteristics and structure information of the top vertex in FMG. The TMC-GCN model is used to classify the encrypted traffic. The encryption stream classification problem is transformed into a graph classification problem, which can effectively deal with data from different data sources and application scenarios. By comparing the performance of TMC-GCN with other classical models in four public datasets, including CICIOT2023, ISCXVPN2016, CICAAGM2017, and GraphDapp, the effectiveness of the FMG algorithm is verified. The experimental results show that the accuracy rate of the TMC-GCN model is 96.13%, the recall rate is 95.04%, and the F1 rate is 94.54%.
基金supported by the Fundamental Research Funds for Higher Education Institutions of Heilongjiang Province(145209126)the Heilongjiang Province Higher Education Teaching Reform Project under Grant No.SJGY20200770.
摘要The relationship between users and items,which cannot be recovered by traditional techniques,can be extracted by the recommendation algorithm based on the graph convolution network.The current simple linear combination of these algorithms may not be sufficient to extract the complex structure of user interaction data.This paper presents a new approach to address such issues,utilizing the graph convolution network to extract association relations.The proposed approach mainly includes three modules:Embedding layer,forward propagation layer,and score prediction layer.The embedding layer models users and items according to their interaction information and generates initial feature vectors as input for the forward propagation layer.The forward propagation layer designs two parallel graph convolution networks with self-connections,which extract higher-order association relevance from users and items separately by multi-layer graph convolution.Furthermore,the forward propagation layer integrates the attention factor to assign different weights among the hop neighbors of the graph convolution network fusion,capturing more comprehensive association relevance between users and items as input for the score prediction layer.The score prediction layer introduces MLP(multi-layer perceptron)to conduct non-linear feature interaction between users and items,respectively.Finally,the prediction score of users to items is obtained.The recall rate and normalized discounted cumulative gain were used as evaluation indexes.The proposed approach effectively integrates higher-order information in user entries,and experimental analysis demonstrates its superiority over the existing algorithms.
基金supported by the Natural Science Foundation of China(Grant Nos.51979158,51639008,51679135,and 51422905)the Program of Shanghai Academic Research Leader by Science and Technology Commission of Shanghai Municipality(Project No.19XD1421900)。
摘要Knowledge of pore-water pressure(PWP)variation is fundamental for slope stability.A precise prediction of PWP is difficult due to complex physical mechanisms and in situ natural variability.To explore the applicability and advantages of recurrent neural networks(RNNs)on PWP prediction,three variants of RNNs,i.e.,standard RNN,long short-term memory(LSTM)and gated recurrent unit(GRU)are adopted and compared with a traditional static artificial neural network(ANN),i.e.,multi-layer perceptron(MLP).Measurements of rainfall and PWP of representative piezometers from a fully instrumented natural slope in Hong Kong are used to establish the prediction models.The coefficient of determination(R^2)and root mean square error(RMSE)are used for model evaluations.The influence of input time series length on the model performance is investigated.The results reveal that MLP can provide acceptable performance but is not robust.The uncertainty bounds of RMSE of the MLP model range from 0.24 kPa to 1.12 k Pa for the selected two piezometers.The standard RNN can perform better but the robustness is slightly affected when there are significant time lags between PWP changes and rainfall.The GRU and LSTM models can provide more precise and robust predictions than the standard RNN.The effects of the hidden layer structure and the dropout technique are investigated.The single-layer GRU is accurate enough for PWP prediction,whereas a double-layer GRU brings extra time cost with little accuracy improvement.The dropout technique is essential to overfitting prevention and improvement of accuracy.
摘要A brain-computer interface(BCI)system is one of the most effective ways that translates brain signals into output commands.Different imagery activities can be classified based on the changes inμandβrhythms and their spatial distributions.Multi-layer perceptron neural networks(MLP-NNs)are commonly used for classification.Training such MLP-NNs has great importance in a way that has attracted many researchers to this field recently.Conventional methods for training NNs,such as gradient descent and recursive methods,have some disadvantages including low accuracy,slow convergence speed and trapping in local minimums.In this paper,in order to overcome these issues,the MLP-NN trained by a hybrid population-physics-based algorithm,the combination of particle swarm optimization and gravitational search algorithm(PSOGSA),is proposed for our classification problem.To show the advantages of using PSOGSA that trains NNs,this algorithm is compared with other meta-heuristic algorithms such as particle swarm optimization(PSO),gravitational search algorithm(GSA)and new versions of PSO.The metrics that are discussed in this paper are the speed of convergence and classification accuracy metrics.The results show that the proposed algorithm in most subjects of encephalography(EEG)dataset has very better or acceptable performance compared to others.
摘要Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.
基金Sponsored by Korea Science and Engineering Foundation(KOSEF)Funded by Korea Government(MEST)(2010-0022521)
摘要High rigidity twenty-high Sendzimir mills (ZRMs) are widely used for rolling stainless steels, silicon sheets, etc. A ZRM uses a small diameter work roll to produce massive rolling forces. Since a work roll with a small diameter can be bent easily, strips often have complex shapes with mixed quarter and deep edge waves in the shape of plates. In order to solve this problem, fuzzy neural network controls are generally used for shape: recognition in ZRM control systems. Among various neural network types, the multi-layer perceptron (MLP) is typically used in current ZRMs. However, an MLP causes the loss of a large amount of shape recognition data. To improve the shape recognition per- formance of ZRM control systems, echo state networks (ESNs) are proposed to be used. Through simulation re- sults, it is found that shape recognition performance could be improved using the proposed ESN method.
摘要The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabilized confined jet diffusion flames in the presence of different geometries of bluff-body burners. Two stabilizer disc burners tapered at 30° and 60° and another frustum cone of 60°/30° inclination angle were employed all having the same diameter of 80 (mm) acting as flame holders. The measured radial mean temperature profiles of the developed stabilized flames at different normalized axial distances (x/dj) were considered as the model example of the physical process. The RSM and ANN methods analyze the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x/dj) on the measured temperature of the flames, to find the predicted maximum temperature and the corresponding process variables. A three-layered Feed Forward Neural Network in conjugation with the hyperbolic tangent sigmoid (tansig) as transfer function and the optimized topology of 2:10:1 (input neurons: hidden neurons: output neurons) was developed. Also the ANN method has been employed to illustrate such effects in the three and two dimensions and shows the location of the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of R2 and F Ratio are 0.868 - 0.947 and 231.7 - 864.1 for RSM method compared to 0.964 - 0.987 and 2878.8 7580.7 for ANN method beside lower values for error analysis terms.
摘要In addition to the effect that the COVID-19 pandemic has had on the physical and mental health of individuals,it has also led to a change in the mental and emotional state of many employees.Especially among businesses and private companies,which faced many restrictions due to the special conditions of the pandemic.Therefore,the present study aimed to design an artificial neural network with MLP technique to analyze the relationship between demographic variables,resilience,COVID-19 and burnout in start-ups in Iran.The research method was quantitative.Managers and employees of start-ups formed the statistical population of the study,based on the statistical sample size of the unlimited community,384 of them were tested.For data gathering,standard questionnaires include of MBI-GS and BRCS and researcher-made questionnaire of stress caused by COVID-19 were used.The validity of the questionnaires was confirmed by a panel of experts and their reliability was confirmed by Cronbach’s alpha coefficient.The number of neurons in the input layer was equal to 10,the number of neurons in the 1st hidden layer was equal to 7,the number of neurons in the output layer was equal to 1,and the number of epochs was equal to 500.70%of the data were used for training and 30%for testing.In the designed artificial neural network,all experiment data except one were correctly predicted and the obtained MAE error was less than 0.012%.Finally,he precision and correction of the presented model was confirmed by the obtained results.
摘要One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP) with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion) faced when using the Inverse Geometric Models implementation (IGM) in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.
摘要This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.
摘要Biometric techniques require critical operations of digital processing for identification of individuals. In this context, this paper aims to develop a system for automatic processing of fingerprint identification by their minutiae using Artificial Neural Networks (ANN), which reveals to be highly effective. The ANN method implemented is a based on Multi-Layer Perceptron (MLP) model, which utilizes the algorithm of retro-propagation of gradient during the learning process. In such a process, the mean square error generated represents the specific parameter for the identification phase by comparing a fingerprint taken from a crime scene with those of a reference database.
摘要In the context of new risks and threats associated to nuclear, biological and chemical (NBC) attacks, and given the shortcomings of certain analytical methods such as principal component analysis (PCA), a neural network approach seems to be more accurate. PCA consists in projecting the spectrum of a gas collected from a remote sensing system in, firstly, a three-dimensional space, then in a two-dimensional one using a model of Multi-Layer Perceptron based neural network. It adopts during the learning process, the back propagation algorithm of the gradient, in which the mean square error output is continuously calculated and compared to the input until it reaches a minimal threshold value. This aims to correct the synaptic weights of the network. So, the Artificial Neural Network (ANN) tends to be more efficient in the classification process. This paper emphasizes the contribution of the ANN method in the spectral data processing, classification and identification and in addition, its fast convergence during the back propagation of the gradient.
摘要Background:Diabetes and hypertension are two of the commonest diseases in the world.As they unfavorably affect people of different age groups,they have become a cause of concern and must be predicted and diagnosed well in advance.Objective:This research aims to determine the effectiveness of artificial neural networks(ANNs)in predicting diabetes and blood pressure diseases and to point out the factors which have a high impact on these diseases.Sample:This work used two online datasets which consist of data collected from 768 individuals.We applied neural network algorithms to predict if the individuals have those two diseases based on some factors.Diabetes prediction is based on five factors:age,weight,fat-ratio,glucose,and insulin,while blood pressure prediction is based on six factors:age,weight,fat-ratio,blood pressure,alcohol,and smoking.Method:A model based on the Multi-Layer Perceptron Neural Network(MLP)was implemented.The inputs of the network were the factors for each disease,while the output was the prediction of the disease’s occurrence.The model performance was compared with other classifiers such as Support Vector Machine(SVM)and K-Nearest Neighbors(KNN).We used performance metrics measures to assess the accuracy and performance of MLP.Also,a tool was implemented to help diagnose the diseases and to understand the results.Result:The model predicted the two diseases with correct classification rate(CCR)of 77.6%for diabetes and 68.7%for hypertension.The results indicate that MLP correctly predicts the probability of being diseased or not,and the performance can be significantly increased compared with both SVM and KNN.This shows MLPs effectiveness in early disease prediction.
摘要为解决现有算法在处理不同特征点云时存在普适性不足、效率低下、难以应用于工程实际的问题,提出一种基于神经网络的岩体结构面智能识别方法,具体包括4个步骤。首先,对原始点云进行标准化预处理操作,并人工选取具有代表性的特征区域,以构建高质量的训练样本集;其次,采用CFSFDP(clustering by fast search and find of density peaks)聚类算法为样本生成标签;再次,构建并训练多层感知机(multilayer perceptron,MLP)模型和多层卷积神经网络(multi-layer convolutional neural network,MCNN)模型,输入全尺度点云的点法向量进行结构面粗识别,并对2种模型进行比选分析;最后,使用HDBSCAN(hierarchical density-based spatial clustering of applications with noise)算法对分类结果进行细化与产状计算。结果表明:1)采用多层感知机模型处理简单结构面时具有较高的处理速度,而卷积神经网络模型在处理复杂、非均匀点云时展现出更高的分类精度。2)与聚类方法相比,该方法计算时间提升25%~50%,能够有效解决传统算法无法适用于不同复杂点云的问题,且具有很强的鲁棒性。
摘要为进一步提高高光谱影像分类精度,通过引入Network In Network网络结构,构建了一种新的网络模型。该网络模型能够对局部感受野内的数据进行更加抽象的建模,从而能够对影像中的空谱联合特征进行更为抽象的表达。通过在Pavia University和Indian Pines两个数据集上进行验证,实验结果表明,所构建的网络模型能够有效提高分类精度,在减少训练样本的条件下仍具有较好的分类性能。