Accurate classification of brain tumors from medical images is essential for enabling timely diagnosis and effective treatment.This study aimed to develop an innovative method for the diagnosis of brain tumors through...Accurate classification of brain tumors from medical images is essential for enabling timely diagnosis and effective treatment.This study aimed to develop an innovative method for the diagnosis of brain tumors through a Fuzzy Richards Functions-based Ensemble Network(FRE-Net).The parameters of the Richards function are optimized through Grid Search(GS)for selecting an optimal set of parameters.Our proposed method integrates three well-established pre-trained Convolutional Neural Networks(CNNs):MobileNetV1,MobileNetV2,ResNet50V2.To increase the robustness of these models,we incorporate a novel Lightweight Multiscale with Squeeze and Excitation(LiteMSSE)Block,which improves performance by enhancing multi-scale feature extraction and enabling the network to capture more detailed spatial information for focusing on the most relevant features to improve overall diagnostic performance.Additionally,probabilities from the individual models are aggregated using a Fuzzy Richards Functions approach,which reduces the error between observed and ground truth data,further enhancing detection accuracy.The key innovation of this study lies in the design of novel LiteMSSE Block and use of Fuzzy Richard Function,which together enhance multi-scale feature extraction and combines diverse model predictions intelligently.The proposed FRE-Net method achieves an impressive accuracy of 98.47%on the four-class Kaggle dataset and 99.00%on the BR35H dataset by highlighting its potential as a powerful tool for diagnosis of brain MRI more precisely.Through extensive evaluations,we determine that our proposed ensemble method outperforms individual backbone models and existing methods.展开更多
Considering the defects of low accuracy and slow speed existing in traditional flood loss assessment, firstly, the technical route of flood loss assessment was presented based on the neural network ensemble. Secondly,...Considering the defects of low accuracy and slow speed existing in traditional flood loss assessment, firstly, the technical route of flood loss assessment was presented based on the neural network ensemble. Secondly, through the study of certain country of Poyang Lake district, the flood loss assessment indicators of the test area were analyzed and extracted by utilizing analytic hierarchy process (AHP), and the weights of the impact factors were assigned. Subsequently, the approaches to generate individuals and conclusions of neural network ensemble model were also investigated. In the platform of C# language and neural network library under AForge.NET open source, a flood loss assessment program which could rapidly build neural network ensemble models was developed. Finally, the proposed method was tested and verified. The comparison results between the assessment results of the proposed method and the actual statistical flood loss proved the feasibility of this method, thus a new approach for flood loss assessment was provided.展开更多
Land evaluation factors often contain continuous-, discrete- and nominal-valued attributes. In traditional land evaluation, these different attributes are usually graded into categorical indexes by land resource exper...Land evaluation factors often contain continuous-, discrete- and nominal-valued attributes. In traditional land evaluation, these different attributes are usually graded into categorical indexes by land resource experts, and the evaluation results rely heavily on experts' experiences. In order to overcome the shortcoming, we presented a fuzzy neural network ensemble method that did not require grading the evaluation factors into categorical indexes and could evaluate land resources by using the three kinds of attribute values directly. A fuzzy back propagation neural network (BPNN), a fuzzy radial basis function neural network (RBFNN), a fuzzy BPNN ensemble, and a fuzzy RBFNN ensemble were used to evaluate the land resources in Guangdong Province. The evaluation results by using the fuzzy BPNN ensemble and the fuzzy RBFNN ensemble were much better than those by using the single fuzzy BPNN and the single fuzzy RBFNN, and the error rate of the single fuzzy RBFNN or fuzzy RBFNN ensemble was lower than that of the single fuzzy BPNN or fuzzy BPNN ensemble, respectively. By using the fuzzy neural network ensembles, the validity of land resource evaluation was improved and reliance on land evaluators' experiences was considerably reduced.展开更多
Chemical processes are complex, for which traditional neural network models usually can not lead to satisfactory accuracy. Selective neural network ensemble is an effective way to enhance the generalization accuracy o...Chemical processes are complex, for which traditional neural network models usually can not lead to satisfactory accuracy. Selective neural network ensemble is an effective way to enhance the generalization accuracy of networks, but there are some problems, e.g., lacking of unified definition of diversity among component neural networks and difficult to improve the accuracy by selecting if the diversities of available networks are small. In this study, the output errors of networks are vectorized, the diversity of networks is defined based on the error vectors, and the size of ensemble is analyzed. Then an error vectorization based selective neural network ensemble (EVSNE) is proposed, in which the error vector of each network can offset that of the other networks by training the component networks orderly. Thus the component networks have large diversity. Experiments and comparisons over standard data sets and actual chemical process data set for production of high-density polyethylene demonstrate that EVSNE performs better in generalization ability.展开更多
Irretrievable loss of vision is the predominant result of Glaucoma in the retina.Recently,multiple approaches have paid attention to the automatic detection of glaucoma on fundus images.Due to the interlace of blood v...Irretrievable loss of vision is the predominant result of Glaucoma in the retina.Recently,multiple approaches have paid attention to the automatic detection of glaucoma on fundus images.Due to the interlace of blood vessels and the herculean task involved in glaucoma detection,the exactly affected site of the optic disc of whether small or big size cup,is deemed challenging.Spatially Based Ellipse Fitting Curve Model(SBEFCM)classification is suggested based on the Ensemble for a reliable diagnosis of Glaucomain theOptic Cup(OC)and Optic Disc(OD)boundary correspondingly.This research deploys the Ensemble Convolutional Neural Network(CNN)classification for classifying Glaucoma or Diabetes Retinopathy(DR).The detection of the boundary between the OC and the OD is performed by the SBEFCM,which is the latest weighted ellipse fitting model.The SBEFCM that enhances and widens the multi-ellipse fitting technique is proposed here.There is a preprocessing of input fundus image besides segmentation of blood vessels to avoid interlacing surrounding tissues and blood vessels.The ascertaining of OCandODboundary,which characterizedmany output factors for glaucoma detection,has been developed by EnsembleCNNclassification,which includes detecting sensitivity,specificity,precision,andArea Under the receiver operating characteristic Curve(AUC)values accurately by an innovative SBEFCM.In terms of contrast,the proposed Ensemble CNNsignificantly outperformed the current methods.展开更多
Ensemble learning for anomaly detection of data structured into a complex network has been barely studied due to the inconsistent performance of complex network characteristics and the lack of inherent objective funct...Ensemble learning for anomaly detection of data structured into a complex network has been barely studied due to the inconsistent performance of complex network characteristics and the lack of inherent objective function. We propose the intuitionistic fuzzy set(IFS)-based anomaly detection, a new two-phase ensemble method for anomaly detection based on IFS, and apply it to the abnormal behavior detection problem in temporal complex networks.Firstly, it constructs the IFS of a single network characteristic, which quantifies the degree of membership,non-membership and hesitation of each network characteristic to the defined linguistic variables so that makes the unuseful or noise characteristics become part of the detection. To build an objective intuitionistic fuzzy relationship, we propose a Gaussian distribution-based membership function which gives a variable hesitation degree. Then, for the fuzzification of multiple network characteristics, the intuitionistic fuzzy weighted geometric operator is adopted to fuse multiple IFSs and to avoid the inconsistence of multiple characteristics. Finally, the score function and precision function are used to sort the fused IFS. Finally, we carry out extensive experiments on several complex network datasets for anomaly detection, and the results demonstrate the superiority of our method to state-of-the-art approaches, validating the effectiveness of our method.展开更多
It is important for the autonomous system to understand environmental information.For the autonomous system,it is desirable to have a strong generalization ability to deal with different complex environmental informat...It is important for the autonomous system to understand environmental information.For the autonomous system,it is desirable to have a strong generalization ability to deal with different complex environmental information,as well as have high accuracy and quick inference speed.Network ensemble architecture is a good choice to improve network performance.However,it is unsuitable for real-time applications on the autonomous system.To tackle this problem,a new neural network ensemble named partial-shared ensemble network(PSENet)is presented.PSENet changes network ensemble architecture from parallel architecture to scatter architecture and merges multiple component networks together to accelerate the inference speed.To make component networks independent of each other,a training method is designed to train the network ensemble architecture.Experiments on Camvid and CIFAR-10 reveal that PSENet achieves quick inference speed while maintaining the ability of ensemble learning.In the real world,PSENet is deployed on the unmanned system and deals with vision tasks such as semantic segmentation and environmental prediction in different fields.展开更多
There has been many methods in constructing neural network (NN) ensembles, where the method of simultaneous training has succeed in generalization performance and efficiency. But just like regular methods of constru...There has been many methods in constructing neural network (NN) ensembles, where the method of simultaneous training has succeed in generalization performance and efficiency. But just like regular methods of constructing NN ensembles, it follows the two steps, first training component networks, and then combining them. As the two steps being independent, an assumption is used to facilitate interactions among NNs during the training stage. This paper presents a compact ensemble method which integrates the two steps of ensemble construction into one step by attempting to train individual NNs in an ensemble and weigh the individual members adaptively according to their individual performance in the same learning process. This provides an opportunity for the individual NNs to interact with each other based on their real contributions to the ensemble. The classification performance of NN compact ensemble (NNCE) was validated through some benchmark problems in machine learning, including Australian credit card assessment, pima Indians diabetes, heart disease, breast cancer and glass. Compared with other ensembles, the classification error rate of NNCE can be decreased by 0.45% to 68%. In addition, the NNCE was applied to fault diagnosis for rolling element bearing. The 11 time-domain statistical features are extracted as the properties of data, and the NNCE is employed to classify the data. With the results of several experiments, the compact ensemble method is shown to give good generalization performance. The compact ensemble method can recognize the different fault types and various fault degrees of the same fault type.展开更多
Accurate prediction of solubility data in the Sodium Chloride-Sodium Sulfate-Water system is essential.It provides theoretical support for salt lake resource development and wastewater treatment technologies.This stud...Accurate prediction of solubility data in the Sodium Chloride-Sodium Sulfate-Water system is essential.It provides theoretical support for salt lake resource development and wastewater treatment technologies.This study proposes an innovative solubility prediction approach.It addresses the limitations of traditional thermodynamic models.This is particularly important when experimental data from various sources contain inconsistencies.Our approach combines the Weighted Local Outlier Factor technique for anomaly detection with a Deep Ensemble Neural Network architecture.This methodology effectively removes local outliers while preserving data distribution integrity,and integrates multiple neural network sub-models to comprehensively capture system features while minimizing individual model biases.Experimental validation demonstrates exceptional prediction performance across temperatures from−20℃to 150℃,achieving a coefficient of determination of 0.989 after Bayesian hyperparameter optimization.This data-driven approach provides more accurate and universally applicable solubility predictions than conventional thermodynamic models,offering theoretical guidance for industrial applications in salt lake resource utilization,separation process optimization,and environmental salt management systems.展开更多
This paper introduces supervised learning model, and surveys related research work. The paper is organised as follows. A supervised learning model is firstly described. The bias-variance trade-off is then discussed fo...This paper introduces supervised learning model, and surveys related research work. The paper is organised as follows. A supervised learning model is firstly described. The bias-variance trade-off is then discussed for the supervised learning model. Based on the bias-variance trade-off, both the single neural network approaches and the neural network ensemble approaches are overviewed, and problems with the existing approaches are indicated. Finally, the paper concludes with specifying potential future research directions.展开更多
Emotion recognition based on facial expressions is one of the most critical elements of human-machine interfaces.Most conventional methods for emotion recognition using facial expressions use the entire facial image t...Emotion recognition based on facial expressions is one of the most critical elements of human-machine interfaces.Most conventional methods for emotion recognition using facial expressions use the entire facial image to extract features and then recognize specific emotions through a pre-trained model.In contrast,this paper proposes a novel feature vector extraction method using the Euclidean distance between the landmarks changing their positions according to facial expressions,especially around the eyes,eyebrows,nose,andmouth.Then,we apply a newclassifier using an ensemble network to increase emotion recognition accuracy.The emotion recognition performance was compared with the conventional algorithms using public databases.The results indicated that the proposed method achieved higher accuracy than the traditional based on facial expressions for emotion recognition.In particular,our experiments with the FER2013 database show that our proposed method is robust to lighting conditions and backgrounds,with an average of 25% higher performance than previous studies.Consequently,the proposed method is expected to recognize facial expressions,especially fear and anger,to help prevent severe accidents by detecting security-related or dangerous actions in advance.展开更多
Because of the difficulty in deciding on the structure of BP neural network in operational meteorological application and the tendency for the network to transform to an issue of local solution, a hybrid Particle Swar...Because of the difficulty in deciding on the structure of BP neural network in operational meteorological application and the tendency for the network to transform to an issue of local solution, a hybrid Particle Swarm Optimization Algorithm based on Artificial Neural Network (PSO-BP) model is proposed for monthly mean rainfall of the whole area of Guangxi. It combines Particle Swarm Optimization (PSO) with BP, that is, the number of hidden nodes and connection weights are optimized by the implementation of PSO operation. The method produces a better network architecture and initial connection weights, trains the traditional backward propagation again by training samples. The ensemble strategy is carried out for the linear programming to calculate the best weights based on the "east sum of the error absolute value" as the optimal rule. The weighted coefficient of each ensemble individual is obtained. The results show that the method can effectively improve learning and generalization ability of the neural network.展开更多
Neural network ensemble based on rough sets reduct is proposed to decrease the computational complexity of conventional ensemble feature selection algorithm. First, a dynamic reduction technology combining genetic alg...Neural network ensemble based on rough sets reduct is proposed to decrease the computational complexity of conventional ensemble feature selection algorithm. First, a dynamic reduction technology combining genetic algorithm with resampling method is adopted to obtain reducts with good generalization ability. Second, Multiple BP neural networks based on different reducts are built as base classifiers. According to the idea of selective ensemble, the neural network ensemble with best generalization ability can be found by search strategies. Finally, classification based on neural network ensemble is implemented by combining the predictions of component networks with voting. The method has been verified in the experiment of remote sensing image and five UCI datasets classification. Compared with conventional ensemble feature selection algorithms, it costs less time and lower computing complexity, and the classification accuracy is satisfactory.展开更多
Many industrial products are normally processed through multiple manufacturing process stages before it becomes a final product.Statistical process control techniques often utilize standard Shewhart control charts to ...Many industrial products are normally processed through multiple manufacturing process stages before it becomes a final product.Statistical process control techniques often utilize standard Shewhart control charts to monitor these process stages.If the process stages are independent,this is a meaningful procedure.However,they are not independent in many manufacturing scenarios.The standard Shewhart control charts can not provide the information to determine which process stage or group of process stages has caused the problems(i.e.,standard Shewhart control charts could not diagnose dependent manufacturing process stages).This study proposes a selective neural network ensemble-based cause-selecting system of control charts to monitor these process stages and distinguish incoming quality problems and problems in the current stage of a manufacturing process.Numerical results show that the proposed method is an improvement over the use of separate Shewhart control chart for each of dependent process stages,and even ordinary quality practitioners who lack of expertise in theoretical analysis can implement regression estimation and neural computing readily.展开更多
The multiple classifier system (MCS), composed of multiple diverse classifiers or feed-forward neural networks, can significantly improve the classification or generalization ability of a single classifier. Enlighte...The multiple classifier system (MCS), composed of multiple diverse classifiers or feed-forward neural networks, can significantly improve the classification or generalization ability of a single classifier. Enlightened by the fundamental idea of MCS, the ensemble is introduced into the quick learning for bidirectional associative memory (QLBAM) to construct a BAM ensemble, for improving the storage capacity and the error-correction capability without destroying the simple structure of the component BAM. Simulations show that, with an appropriate "overproduce and choose" strategy or "thinning" algorithm, the proposed BAM ensemble significantly outperforms the single QLBAM in both storage capacity and noise-tolerance capability.展开更多
The gut microbiome forms a complex,scale-free network,where nonlinear interactions among microorganisms link dietary nutrients to host physiology.Traditional methods often struggle with the nonlinearity and sparsity o...The gut microbiome forms a complex,scale-free network,where nonlinear interactions among microorganisms link dietary nutrients to host physiology.Traditional methods often struggle with the nonlinearity and sparsity of microbiome networks,limiting precision in identifying disease-specific key species.In this paper,we introduce Network Ensemble Analysis(NetEnsa),a multistage approach that systematically addresses these limitations.It facilitates the integration of multi-stage analyses to identify a compact,disease-specific set of key species in the gut microbial ecosystem.Exploiting datasets consisting of 7217 metagenomic samples covering 9 disease types from 18 countries,the average number of nodes on the nine datasets is 18.22 and the average AUC is 0.9172.We validated the accuracy of the algorithm and further mined the disease-specific roles of key species from functional analyses.Validation in humanized mice further demonstrates that NetEnsa can effectively link fine-grained nodal analysis with network-wide control.We found that multistage integration can help us identify diseasespecific key species sets with interventional effects.The identification of key species collections provides a solid foundation for the development of more targeted probiotics and prebiotics.展开更多
This paper describes negative correlation learning for designing neural network ensembles. Negative correlation learning has been firstly analysed in terms of minimising mutual information on a regression task. By min...This paper describes negative correlation learning for designing neural network ensembles. Negative correlation learning has been firstly analysed in terms of minimising mutual information on a regression task. By minimising the mutual information between variables extracted by two neural networks, they are forced to convey different information a-bout some features of their input. Based on the decision boundaries and correct response sets, negative correlation learning has been further studied on two pattern classification problems. The purpose of examining the decision boundaries and the correct response sets is not only to illustrate the learning behavior of negative correlation learning, but also to cast light on how to design more effective neural network ensembles. The experimental results showed the decision boundary of the trained neural network ensemble by negative correlation learning is almost as good as the optimum decision boundary.展开更多
After the consideration of the nonlinear nature changes of monsoon index,and the subjective determination of network structure in traditional artificial neural network prediction modeling,monthly and seasonal monsoon ...After the consideration of the nonlinear nature changes of monsoon index,and the subjective determination of network structure in traditional artificial neural network prediction modeling,monthly and seasonal monsoon intensity index prediction is studied in this paper by using nonlinear genetic neural network ensemble prediction(GNNEP)modeling.It differs from traditional prediction modeling in the following aspects: (1)Input factors of the GNNEP model of monsoon index were selected from a large quantity of preceding period high correlation factors,such as monthly sea temperature fields,monthly 500-hPa air temperature fields,monthly 200-hPa geopotential height fields,etc.,and they were also highly information-condensed and system dimensionality-reduced by using the empirical orthogonal function(EOF)method,which effectively condensed the useful information of predictors and therefore controlled the size of network structure of the GNNEP model.(2)In the input design of the GNNEP model,a mean generating function(MGF)series of predictand(monsoon index)was added as an input factor;the contrast analysis of results of predic- tion experiments by a physical variable predictor-predictand MGF GNNEP model and a physical variable predictor GNNEP model shows that the incorporation of the periodical variation of predictand(monsoon index)is very effective in improving the prediction of monsoon index.(3)Different from the traditional neural network modeling,the GNNEP modeling is able to objectively determine the network structure of the GNNNEP model,and the model constructed has a better generalization capability.In the case of identical predictors,prediction modeling samples,and independent prediction samples,the prediction accuracy of our GNNEP model combined with the system dimensionality reduction technique of predictors is clearly higher than that of the traditional stepwise regression model using the traditional treatment technique of predictors,suggesting that the GNNEP model opens up a vast range of possibilities for operational weather prediction.展开更多
Facial expression recognition(FER)is still challenging due to the small interclass discrepancy in facial expression data.In view of the significance of facial crucial regions for FER,many existing studies utilize the ...Facial expression recognition(FER)is still challenging due to the small interclass discrepancy in facial expression data.In view of the significance of facial crucial regions for FER,many existing studies utilize the prior information from some annotated crucial points to improve the performance of FER.However,it is complicated and time-consuming to manually annotate facial crucial points,especially for vast wild expression images.Based on this,a local non-local joint network is proposed to adaptively enhance the facial crucial regions in feature learning of FER in this paper.In the proposed method,two parts are constructed based on facial local and non-local information,where an ensemble of multiple local networks is proposed to extract local features corresponding to multiple facial local regions and a non-local attention network is addressed to explore the significance of each local region.In particular,the attention weights obtained by the non-local network are fed into the local part to achieve interactive feedback between the facial global and local information.Interestingly,the non-local weights corresponding to local regions are gradually updated and higher weights are given to more crucial regions.Moreover,U-Net is employed to extract the integrated features of deep semantic information and low hierarchical detail information of expression images.Finally,experimental results illustrate that the proposed method achieves more competitive performance than several state-of-the-art methods on five benchmark datasets.展开更多
With the advancement of satellite technology,a considerable amount of very high-resolution imagery has become available to be used for the Land Cover and Land Use(LCLU)classification task aiming to categorize remotely...With the advancement of satellite technology,a considerable amount of very high-resolution imagery has become available to be used for the Land Cover and Land Use(LCLU)classification task aiming to categorize remotely sensed images based on their semantic content.Recently,Deep Neural Networks(DNNs)have been widely used for different applications in the field of remote sensing and they have profound impacts;however,improvement of the generalizability and robustness of the DNNs needs to be progressed further to achieve higher accuracy for a variety of sensing geometries and categories.We address this problem by deploying three different Deep Neural Network Ensemble(DNNE)methods and creating a comparative analysis for the LCLU classification task.DNNE enables improvement of the performance of DNNs by ensuring the diversity of the models that are combined.Thus,enhances the generalizability of the models and produces more robust and generalizable outcomes for LCLU classification tasks.The experimental results on NWPU-RESISC45 and AID datasets demonstrate that utilizing the aggregated information from multiple DNNs leads to an increase in classification performance,achieves state-of-the-art,and promotes researchers to make use of DNNE.展开更多
摘要Accurate classification of brain tumors from medical images is essential for enabling timely diagnosis and effective treatment.This study aimed to develop an innovative method for the diagnosis of brain tumors through a Fuzzy Richards Functions-based Ensemble Network(FRE-Net).The parameters of the Richards function are optimized through Grid Search(GS)for selecting an optimal set of parameters.Our proposed method integrates three well-established pre-trained Convolutional Neural Networks(CNNs):MobileNetV1,MobileNetV2,ResNet50V2.To increase the robustness of these models,we incorporate a novel Lightweight Multiscale with Squeeze and Excitation(LiteMSSE)Block,which improves performance by enhancing multi-scale feature extraction and enabling the network to capture more detailed spatial information for focusing on the most relevant features to improve overall diagnostic performance.Additionally,probabilities from the individual models are aggregated using a Fuzzy Richards Functions approach,which reduces the error between observed and ground truth data,further enhancing detection accuracy.The key innovation of this study lies in the design of novel LiteMSSE Block and use of Fuzzy Richard Function,which together enhance multi-scale feature extraction and combines diverse model predictions intelligently.The proposed FRE-Net method achieves an impressive accuracy of 98.47%on the four-class Kaggle dataset and 99.00%on the BR35H dataset by highlighting its potential as a powerful tool for diagnosis of brain MRI more precisely.Through extensive evaluations,we determine that our proposed ensemble method outperforms individual backbone models and existing methods.
基金Project(41061041)supported by the National Natural Science Foundation of ChinaProject(2010gzs0084)supported by the Natural Science Foundation of Jiangxi Province,China
摘要Considering the defects of low accuracy and slow speed existing in traditional flood loss assessment, firstly, the technical route of flood loss assessment was presented based on the neural network ensemble. Secondly, through the study of certain country of Poyang Lake district, the flood loss assessment indicators of the test area were analyzed and extracted by utilizing analytic hierarchy process (AHP), and the weights of the impact factors were assigned. Subsequently, the approaches to generate individuals and conclusions of neural network ensemble model were also investigated. In the platform of C# language and neural network library under AForge.NET open source, a flood loss assessment program which could rapidly build neural network ensemble models was developed. Finally, the proposed method was tested and verified. The comparison results between the assessment results of the proposed method and the actual statistical flood loss proved the feasibility of this method, thus a new approach for flood loss assessment was provided.
基金the National Natural Science Foundation of China (No.40671145)the Natural Science Foundation of Guangdong Province (Nos.04300504 and 05006623)and the Science and Technology Plan Foundation of Guangdong Province (Nos.2005B20701008,2005B10101028,and 2004B20701006).
摘要Land evaluation factors often contain continuous-, discrete- and nominal-valued attributes. In traditional land evaluation, these different attributes are usually graded into categorical indexes by land resource experts, and the evaluation results rely heavily on experts' experiences. In order to overcome the shortcoming, we presented a fuzzy neural network ensemble method that did not require grading the evaluation factors into categorical indexes and could evaluate land resources by using the three kinds of attribute values directly. A fuzzy back propagation neural network (BPNN), a fuzzy radial basis function neural network (RBFNN), a fuzzy BPNN ensemble, and a fuzzy RBFNN ensemble were used to evaluate the land resources in Guangdong Province. The evaluation results by using the fuzzy BPNN ensemble and the fuzzy RBFNN ensemble were much better than those by using the single fuzzy BPNN and the single fuzzy RBFNN, and the error rate of the single fuzzy RBFNN or fuzzy RBFNN ensemble was lower than that of the single fuzzy BPNN or fuzzy BPNN ensemble, respectively. By using the fuzzy neural network ensembles, the validity of land resource evaluation was improved and reliance on land evaluators' experiences was considerably reduced.
基金Supported by the National Natural Science Foundation of China (61074153, 61104131)the Fundamental Research Fundsfor Central Universities of China (ZY1111, JD1104)
摘要Chemical processes are complex, for which traditional neural network models usually can not lead to satisfactory accuracy. Selective neural network ensemble is an effective way to enhance the generalization accuracy of networks, but there are some problems, e.g., lacking of unified definition of diversity among component neural networks and difficult to improve the accuracy by selecting if the diversities of available networks are small. In this study, the output errors of networks are vectorized, the diversity of networks is defined based on the error vectors, and the size of ensemble is analyzed. Then an error vectorization based selective neural network ensemble (EVSNE) is proposed, in which the error vector of each network can offset that of the other networks by training the component networks orderly. Thus the component networks have large diversity. Experiments and comparisons over standard data sets and actual chemical process data set for production of high-density polyethylene demonstrate that EVSNE performs better in generalization ability.
摘要Irretrievable loss of vision is the predominant result of Glaucoma in the retina.Recently,multiple approaches have paid attention to the automatic detection of glaucoma on fundus images.Due to the interlace of blood vessels and the herculean task involved in glaucoma detection,the exactly affected site of the optic disc of whether small or big size cup,is deemed challenging.Spatially Based Ellipse Fitting Curve Model(SBEFCM)classification is suggested based on the Ensemble for a reliable diagnosis of Glaucomain theOptic Cup(OC)and Optic Disc(OD)boundary correspondingly.This research deploys the Ensemble Convolutional Neural Network(CNN)classification for classifying Glaucoma or Diabetes Retinopathy(DR).The detection of the boundary between the OC and the OD is performed by the SBEFCM,which is the latest weighted ellipse fitting model.The SBEFCM that enhances and widens the multi-ellipse fitting technique is proposed here.There is a preprocessing of input fundus image besides segmentation of blood vessels to avoid interlacing surrounding tissues and blood vessels.The ascertaining of OCandODboundary,which characterizedmany output factors for glaucoma detection,has been developed by EnsembleCNNclassification,which includes detecting sensitivity,specificity,precision,andArea Under the receiver operating characteristic Curve(AUC)values accurately by an innovative SBEFCM.In terms of contrast,the proposed Ensemble CNNsignificantly outperformed the current methods.
基金Supported by the National Natural Science Foundation of China under Grant No 61671142the Fundamental Research Funds for the Central Universities under Grant No 02190022117021
摘要Ensemble learning for anomaly detection of data structured into a complex network has been barely studied due to the inconsistent performance of complex network characteristics and the lack of inherent objective function. We propose the intuitionistic fuzzy set(IFS)-based anomaly detection, a new two-phase ensemble method for anomaly detection based on IFS, and apply it to the abnormal behavior detection problem in temporal complex networks.Firstly, it constructs the IFS of a single network characteristic, which quantifies the degree of membership,non-membership and hesitation of each network characteristic to the defined linguistic variables so that makes the unuseful or noise characteristics become part of the detection. To build an objective intuitionistic fuzzy relationship, we propose a Gaussian distribution-based membership function which gives a variable hesitation degree. Then, for the fuzzification of multiple network characteristics, the intuitionistic fuzzy weighted geometric operator is adopted to fuse multiple IFSs and to avoid the inconsistence of multiple characteristics. Finally, the score function and precision function are used to sort the fused IFS. Finally, we carry out extensive experiments on several complex network datasets for anomaly detection, and the results demonstrate the superiority of our method to state-of-the-art approaches, validating the effectiveness of our method.
基金supported by the National Key Research and Development Program of China under Grant 2019YFC1511401the National Natural Science Foundation of China under Grant 62173038 and 61103157+1 种基金Science Foundation for Young Scholars of Tobacco Research Institute of Chinese Academy of Agricultural Sciences under Grant 2021B05Key Scientific and Tech-nological Research and Development Project of China National Tobacco Corporation under Grant 110202102007.
摘要It is important for the autonomous system to understand environmental information.For the autonomous system,it is desirable to have a strong generalization ability to deal with different complex environmental information,as well as have high accuracy and quick inference speed.Network ensemble architecture is a good choice to improve network performance.However,it is unsuitable for real-time applications on the autonomous system.To tackle this problem,a new neural network ensemble named partial-shared ensemble network(PSENet)is presented.PSENet changes network ensemble architecture from parallel architecture to scatter architecture and merges multiple component networks together to accelerate the inference speed.To make component networks independent of each other,a training method is designed to train the network ensemble architecture.Experiments on Camvid and CIFAR-10 reveal that PSENet achieves quick inference speed while maintaining the ability of ensemble learning.In the real world,PSENet is deployed on the unmanned system and deals with vision tasks such as semantic segmentation and environmental prediction in different fields.
基金supported by National Natural Science Foundation of China(Grant No.50575179)National Hi-tech Research and Development Program of China(863 Program,Grant No.2006AA04Z420)
摘要There has been many methods in constructing neural network (NN) ensembles, where the method of simultaneous training has succeed in generalization performance and efficiency. But just like regular methods of constructing NN ensembles, it follows the two steps, first training component networks, and then combining them. As the two steps being independent, an assumption is used to facilitate interactions among NNs during the training stage. This paper presents a compact ensemble method which integrates the two steps of ensemble construction into one step by attempting to train individual NNs in an ensemble and weigh the individual members adaptively according to their individual performance in the same learning process. This provides an opportunity for the individual NNs to interact with each other based on their real contributions to the ensemble. The classification performance of NN compact ensemble (NNCE) was validated through some benchmark problems in machine learning, including Australian credit card assessment, pima Indians diabetes, heart disease, breast cancer and glass. Compared with other ensembles, the classification error rate of NNCE can be decreased by 0.45% to 68%. In addition, the NNCE was applied to fault diagnosis for rolling element bearing. The 11 time-domain statistical features are extracted as the properties of data, and the NNCE is employed to classify the data. With the results of several experiments, the compact ensemble method is shown to give good generalization performance. The compact ensemble method can recognize the different fault types and various fault degrees of the same fault type.
基金support of the Natural Science Foundation of Qinghai Province of China(2024-ZJ-940)Qinghai University Research Ability Enhancement Project(2025KTST02)are greatly appreciated.
摘要Accurate prediction of solubility data in the Sodium Chloride-Sodium Sulfate-Water system is essential.It provides theoretical support for salt lake resource development and wastewater treatment technologies.This study proposes an innovative solubility prediction approach.It addresses the limitations of traditional thermodynamic models.This is particularly important when experimental data from various sources contain inconsistencies.Our approach combines the Weighted Local Outlier Factor technique for anomaly detection with a Deep Ensemble Neural Network architecture.This methodology effectively removes local outliers while preserving data distribution integrity,and integrates multiple neural network sub-models to comprehensively capture system features while minimizing individual model biases.Experimental validation demonstrates exceptional prediction performance across temperatures from−20℃to 150℃,achieving a coefficient of determination of 0.989 after Bayesian hyperparameter optimization.This data-driven approach provides more accurate and universally applicable solubility predictions than conventional thermodynamic models,offering theoretical guidance for industrial applications in salt lake resource utilization,separation process optimization,and environmental salt management systems.
基金Supported by the National Natural Science Foundation of China(60133010)
摘要This paper introduces supervised learning model, and surveys related research work. The paper is organised as follows. A supervised learning model is firstly described. The bias-variance trade-off is then discussed for the supervised learning model. Based on the bias-variance trade-off, both the single neural network approaches and the neural network ensemble approaches are overviewed, and problems with the existing approaches are indicated. Finally, the paper concludes with specifying potential future research directions.
基金supported by the Healthcare AI Convergence R&D Program through the National IT Industry Promotion Agency of Korea(NIPA)funded by the Ministry of Science and ICT(No.S0102-23-1007)the Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(NRF-2017R1A6A1A03015496).
摘要Emotion recognition based on facial expressions is one of the most critical elements of human-machine interfaces.Most conventional methods for emotion recognition using facial expressions use the entire facial image to extract features and then recognize specific emotions through a pre-trained model.In contrast,this paper proposes a novel feature vector extraction method using the Euclidean distance between the landmarks changing their positions according to facial expressions,especially around the eyes,eyebrows,nose,andmouth.Then,we apply a newclassifier using an ensemble network to increase emotion recognition accuracy.The emotion recognition performance was compared with the conventional algorithms using public databases.The results indicated that the proposed method achieved higher accuracy than the traditional based on facial expressions for emotion recognition.In particular,our experiments with the FER2013 database show that our proposed method is robust to lighting conditions and backgrounds,with an average of 25% higher performance than previous studies.Consequently,the proposed method is expected to recognize facial expressions,especially fear and anger,to help prevent severe accidents by detecting security-related or dangerous actions in advance.
基金Natural Science Foundation of Guangxi (0832019Z)Natural Science Foundation of China (40675023)
摘要Because of the difficulty in deciding on the structure of BP neural network in operational meteorological application and the tendency for the network to transform to an issue of local solution, a hybrid Particle Swarm Optimization Algorithm based on Artificial Neural Network (PSO-BP) model is proposed for monthly mean rainfall of the whole area of Guangxi. It combines Particle Swarm Optimization (PSO) with BP, that is, the number of hidden nodes and connection weights are optimized by the implementation of PSO operation. The method produces a better network architecture and initial connection weights, trains the traditional backward propagation again by training samples. The ensemble strategy is carried out for the linear programming to calculate the best weights based on the "east sum of the error absolute value" as the optimal rule. The weighted coefficient of each ensemble individual is obtained. The results show that the method can effectively improve learning and generalization ability of the neural network.
基金supported by the National High-Tech Research and Development Plan of China (No.2007AA04Z224)the National Natural Science Foundation of China (No.60775047, 60835004)
摘要Neural network ensemble based on rough sets reduct is proposed to decrease the computational complexity of conventional ensemble feature selection algorithm. First, a dynamic reduction technology combining genetic algorithm with resampling method is adopted to obtain reducts with good generalization ability. Second, Multiple BP neural networks based on different reducts are built as base classifiers. According to the idea of selective ensemble, the neural network ensemble with best generalization ability can be found by search strategies. Finally, classification based on neural network ensemble is implemented by combining the predictions of component networks with voting. The method has been verified in the experiment of remote sensing image and five UCI datasets classification. Compared with conventional ensemble feature selection algorithms, it costs less time and lower computing complexity, and the classification accuracy is satisfactory.
基金supported in part by the National Natural Science Foundation of China(No.51775279)the Fundamental Research Funds for the Central Universities(Nos. 1005-YAH15055,NS2017034)+2 种基金the China Postdoctoral Science Foundation(No.2016M591838)the Natural Science Foundation of Jiangsu Province (No.BK20150745)the Postdoctoral Science Foundation of of Jiangsu Province(No.1501024C)
摘要Many industrial products are normally processed through multiple manufacturing process stages before it becomes a final product.Statistical process control techniques often utilize standard Shewhart control charts to monitor these process stages.If the process stages are independent,this is a meaningful procedure.However,they are not independent in many manufacturing scenarios.The standard Shewhart control charts can not provide the information to determine which process stage or group of process stages has caused the problems(i.e.,standard Shewhart control charts could not diagnose dependent manufacturing process stages).This study proposes a selective neural network ensemble-based cause-selecting system of control charts to monitor these process stages and distinguish incoming quality problems and problems in the current stage of a manufacturing process.Numerical results show that the proposed method is an improvement over the use of separate Shewhart control chart for each of dependent process stages,and even ordinary quality practitioners who lack of expertise in theoretical analysis can implement regression estimation and neural computing readily.
摘要The multiple classifier system (MCS), composed of multiple diverse classifiers or feed-forward neural networks, can significantly improve the classification or generalization ability of a single classifier. Enlightened by the fundamental idea of MCS, the ensemble is introduced into the quick learning for bidirectional associative memory (QLBAM) to construct a BAM ensemble, for improving the storage capacity and the error-correction capability without destroying the simple structure of the component BAM. Simulations show that, with an appropriate "overproduce and choose" strategy or "thinning" algorithm, the proposed BAM ensemble significantly outperforms the single QLBAM in both storage capacity and noise-tolerance capability.
基金supported by the National Natural Science Foundation of China(32372345)the Fundamental Research Funds for the Central Universities(JUSRP622034)the Collaborative Innovation Center of food safety and quality control in Jiangsu Province.
摘要The gut microbiome forms a complex,scale-free network,where nonlinear interactions among microorganisms link dietary nutrients to host physiology.Traditional methods often struggle with the nonlinearity and sparsity of microbiome networks,limiting precision in identifying disease-specific key species.In this paper,we introduce Network Ensemble Analysis(NetEnsa),a multistage approach that systematically addresses these limitations.It facilitates the integration of multi-stage analyses to identify a compact,disease-specific set of key species in the gut microbial ecosystem.Exploiting datasets consisting of 7217 metagenomic samples covering 9 disease types from 18 countries,the average number of nodes on the nine datasets is 18.22 and the average AUC is 0.9172.We validated the accuracy of the algorithm and further mined the disease-specific roles of key species from functional analyses.Validation in humanized mice further demonstrates that NetEnsa can effectively link fine-grained nodal analysis with network-wide control.We found that multistage integration can help us identify diseasespecific key species sets with interventional effects.The identification of key species collections provides a solid foundation for the development of more targeted probiotics and prebiotics.
基金Supported by the National Natural Science Foundation of China(60133010)
摘要This paper describes negative correlation learning for designing neural network ensembles. Negative correlation learning has been firstly analysed in terms of minimising mutual information on a regression task. By minimising the mutual information between variables extracted by two neural networks, they are forced to convey different information a-bout some features of their input. Based on the decision boundaries and correct response sets, negative correlation learning has been further studied on two pattern classification problems. The purpose of examining the decision boundaries and the correct response sets is not only to illustrate the learning behavior of negative correlation learning, but also to cast light on how to design more effective neural network ensembles. The experimental results showed the decision boundary of the trained neural network ensemble by negative correlation learning is almost as good as the optimum decision boundary.
基金the New Technology Extension Project of China Meteorological Administration under Grant No.GMATG2008M49the National Natural Science Foundation of China under Grant No.40675023
摘要After the consideration of the nonlinear nature changes of monsoon index,and the subjective determination of network structure in traditional artificial neural network prediction modeling,monthly and seasonal monsoon intensity index prediction is studied in this paper by using nonlinear genetic neural network ensemble prediction(GNNEP)modeling.It differs from traditional prediction modeling in the following aspects: (1)Input factors of the GNNEP model of monsoon index were selected from a large quantity of preceding period high correlation factors,such as monthly sea temperature fields,monthly 500-hPa air temperature fields,monthly 200-hPa geopotential height fields,etc.,and they were also highly information-condensed and system dimensionality-reduced by using the empirical orthogonal function(EOF)method,which effectively condensed the useful information of predictors and therefore controlled the size of network structure of the GNNEP model.(2)In the input design of the GNNEP model,a mean generating function(MGF)series of predictand(monsoon index)was added as an input factor;the contrast analysis of results of predic- tion experiments by a physical variable predictor-predictand MGF GNNEP model and a physical variable predictor GNNEP model shows that the incorporation of the periodical variation of predictand(monsoon index)is very effective in improving the prediction of monsoon index.(3)Different from the traditional neural network modeling,the GNNEP modeling is able to objectively determine the network structure of the GNNNEP model,and the model constructed has a better generalization capability.In the case of identical predictors,prediction modeling samples,and independent prediction samples,the prediction accuracy of our GNNEP model combined with the system dimensionality reduction technique of predictors is clearly higher than that of the traditional stepwise regression model using the traditional treatment technique of predictors,suggesting that the GNNEP model opens up a vast range of possibilities for operational weather prediction.
摘要Facial expression recognition(FER)is still challenging due to the small interclass discrepancy in facial expression data.In view of the significance of facial crucial regions for FER,many existing studies utilize the prior information from some annotated crucial points to improve the performance of FER.However,it is complicated and time-consuming to manually annotate facial crucial points,especially for vast wild expression images.Based on this,a local non-local joint network is proposed to adaptively enhance the facial crucial regions in feature learning of FER in this paper.In the proposed method,two parts are constructed based on facial local and non-local information,where an ensemble of multiple local networks is proposed to extract local features corresponding to multiple facial local regions and a non-local attention network is addressed to explore the significance of each local region.In particular,the attention weights obtained by the non-local network are fed into the local part to achieve interactive feedback between the facial global and local information.Interestingly,the non-local weights corresponding to local regions are gradually updated and higher weights are given to more crucial regions.Moreover,U-Net is employed to extract the integrated features of deep semantic information and low hierarchical detail information of expression images.Finally,experimental results illustrate that the proposed method achieves more competitive performance than several state-of-the-art methods on five benchmark datasets.
基金supported by The Scientific and Technological Research Council of Turkey(TÜBİTAK)under the 2210/C Scholarship Program in the Priority Fields in Science and Technology。
摘要With the advancement of satellite technology,a considerable amount of very high-resolution imagery has become available to be used for the Land Cover and Land Use(LCLU)classification task aiming to categorize remotely sensed images based on their semantic content.Recently,Deep Neural Networks(DNNs)have been widely used for different applications in the field of remote sensing and they have profound impacts;however,improvement of the generalizability and robustness of the DNNs needs to be progressed further to achieve higher accuracy for a variety of sensing geometries and categories.We address this problem by deploying three different Deep Neural Network Ensemble(DNNE)methods and creating a comparative analysis for the LCLU classification task.DNNE enables improvement of the performance of DNNs by ensuring the diversity of the models that are combined.Thus,enhances the generalizability of the models and produces more robust and generalizable outcomes for LCLU classification tasks.The experimental results on NWPU-RESISC45 and AID datasets demonstrate that utilizing the aggregated information from multiple DNNs leads to an increase in classification performance,achieves state-of-the-art,and promotes researchers to make use of DNNE.