Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models ...Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.展开更多
There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capaci...There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capacitor components showa continuous and stable charging and discharging state,a hierarchical time-sharing configuration algorithm of distributed energy storage cloud group end region on the power grid side based on multi-scale and multi feature convolution neural network is proposed.Firstly,a voltage stability analysis model based onmulti-scale and multi feature convolution neural network is constructed,and the multi-scale and multi feature convolution neural network is optimized based on Self-OrganizingMaps(SOM)algorithm to analyze the voltage stability of the cloud group end region of distributed energy storage on the grid side under the framework of credibility.According to the optimal scheduling objectives and network size,the distributed robust optimal configuration control model is solved under the framework of coordinated optimal scheduling at multiple time scales;Finally,the time series characteristics of regional power grid load and distributed generation are analyzed.According to the regional hierarchical time-sharing configuration model of“cloud”,“group”and“end”layer,the grid side distributed energy storage cloud group end regional hierarchical time-sharing configuration algorithm is realized.The experimental results show that after applying this algorithm,the best grid side distributed energy storage configuration scheme can be determined,and the stability of grid side distributed energy storage cloud group end region layered timesharing configuration can be improved.展开更多
Alzheimer’s disease(AD)is a neurological disorder that predominantly affects the brain.In the coming years,it is expected to spread rapidly,with limited progress in diagnostic techniques.Various machine learning(ML)a...Alzheimer’s disease(AD)is a neurological disorder that predominantly affects the brain.In the coming years,it is expected to spread rapidly,with limited progress in diagnostic techniques.Various machine learning(ML)and artificial intelligence(AI)algorithms have been employed to detect AD using single-modality data.However,recent developments in ML have enabled the application of these methods to multiple data sources and input modalities for AD prediction.In this study,we developed a framework that utilizes multimodal data(tabular data,magnetic resonance imaging(MRI)images,and genetic information)to classify AD.As part of the pre-processing phase,we generated a knowledge graph from the tabular data and MRI images.We employed graph neural networks for knowledge graph creation,and region-based convolutional neural network approach for image-to-knowledge graph generation.Additionally,we integrated various explainable AI(XAI)techniques to interpret and elucidate the prediction outcomes derived from multimodal data.Layer-wise relevance propagation was used to explain the layer-wise outcomes in the MRI images.We also incorporated submodular pick local interpretable model-agnostic explanations to interpret the decision-making process based on the tabular data provided.Genetic expression values play a crucial role in AD analysis.We used a graphical gene tree to identify genes associated with the disease.Moreover,a dashboard was designed to display XAI outcomes,enabling experts and medical professionals to easily comprehend the predic-tion results.展开更多
Convolutional neural networks (CNNs) have been applied in state-of-the-art visual tracking tasks to represent the target. However, most existing algorithms treat visual tracking as an object-specific task. Therefore...Convolutional neural networks (CNNs) have been applied in state-of-the-art visual tracking tasks to represent the target. However, most existing algorithms treat visual tracking as an object-specific task. Therefore, the model needs to be retrained for different test video sequences. We propose a branch-activated multi-domain convolutional neural network (BAMDCNN). In contrast to most existing trackers based on CNNs which require frequent online training, BAMDCNN only needs offine training and online fine-tuning. Specifically, BAMDCNN exploits category-specific features that are more robust against variations. To allow for learning category-specific information, we introduce a group algorithm and a branch activation method. Experimental results on challenging benchmark show that the proposed algorithm outperforms other state-of-the-art methods. What's more, compared with CNN based trackers, BAMDCNN increases tracking speed.展开更多
Accurate building electricity load forecasting(BELF)can provide a regulatory basis for building energy management systems and promote the transition of buildings toward low-carbon and intelligent operation modes.Howev...Accurate building electricity load forecasting(BELF)can provide a regulatory basis for building energy management systems and promote the transition of buildings toward low-carbon and intelligent operation modes.However,building electricity load is influenced by historical loads,as well as outside environmental conditions such as humidity and temperature,which reduces the prediction accuracy of models.To tackle these challenges,this study presents a BELF model,which consists of a modal component grouping approach,grouped feature attention mechanism,and multi-scale residual depthwise convolution memory module.First,the modal component grouping method analyzes building electricity load in the time domain,frequency domain(via fast fourier transform,FFT),and complexity(via sample entropy,SE),and then performs clustering to achieve precise decomposition of load components with different fluctuation characteristics.Second,the grouped feature attention mechanism assigns suitable importance to various input features to emphasize key factors affecting prediction accuracy.Third,the multi-scale residual depthwise convolution memory module mitigates the impact of long and short-term load variations on BELF by employing residual blocks of depthwise convolution layers with different kernel sizes.Meanwhile,gated recurrent units are used to identify the time-dependent trends of building load.Experimental results on public buildings show that the proposed model outperforms existing models,achieving more than 2.4%improvement in MAPE prediction performance.展开更多
Extracting spatio-temporal cues from neighbouring frames is challenging in video super-resolution(VSR).Although deformable alignment-based VSR methods have shown promise in aligning neighbouring frames with the refere...Extracting spatio-temporal cues from neighbouring frames is challenging in video super-resolution(VSR).Although deformable alignment-based VSR methods have shown promise in aligning neighbouring frames with the reference frame,most existing methods rely on one or a few traditional convolutions to estimate motion offsets for spatio-temporal alignment,restricting receptive field size and alignment accuracy.To address these limitations,we propose an effective spatio-temporal alignment network(ESTA-Net)for VSR.The core component of our method is the group convolution-based alignment module(GCBAM),which utilises cascaded group convolutions to learn offsets across both the original and downsampled resolutions.By employing group convolutions rather than traditional convolutions,GCBAM enables the deformable alignment to achieve a wider receptive field with lower computational cost,thereby improving the accuracy of offset estimation.Additionally,the bi-scale alignment strategy within GCBAM enhances robustness to complex and large-scale motions.Furthermore,we introduce an attention-based feature enhancement module(AFEM)to refine the aligned features,focusing on critical details to improve reconstruction quality.Extensive experiments on standard benchmarks show that our ESTA-Net achieves superior VSR performance against other advanced methods,while maintaining a good equilibrium between model size and performance.展开更多
The ubiquity of mobile devices has driven advancements in mobile object detection.However,challenges in multi-scale object detection in open,complex environments persist due to limited computational resources.Traditio...The ubiquity of mobile devices has driven advancements in mobile object detection.However,challenges in multi-scale object detection in open,complex environments persist due to limited computational resources.Traditional approaches like network compression,quantization,and lightweight design often sacrifice accuracy or feature representation robustness.This article introduces the Fast Multi-scale Channel Shuffling Network(FMCSNet),a novel lightweight detection model optimized for mobile devices.FMCSNet integrates a fully convolutional Multilayer Perceptron(MLP)module,offering global perception without significantly increasing parameters,effectively bridging the gap between CNNs and Vision Transformers.FMCSNet achieves a delicate balance between computation and accuracy mainly by two key modules:the ShiftMLP module,including a shift operation and an MLP module,and a Partial group Convolutional(PGConv)module,reducing computation while enhancing information exchange between channels.With a computational complexity of 1.4G FLOPs and 1.3M parameters,FMCSNet outperforms CNN-based and DWConv-based ShuffleNetv2 by 1%and 4.5%mAP on the Pascal VOC 2007 dataset,respectively.Additionally,FMCSNet achieves a mAP of 30.0(0.5:0.95 IoU threshold)with only 2.5G FLOPs and 2.0M parameters.It achieves 32 FPS on low-performance i5-series CPUs,meeting real-time detection requirements.The versatility of the PGConv module’s adaptability across scenarios further highlights FMCSNet as a promising solution for real-time mobile object detection.展开更多
Many studies based on convolutional neural networks(CNNs)for breast cancer axillary lymph node(ALN)images have focused on large sample analysis and clinical parameter integration,while limited attention has been paid ...Many studies based on convolutional neural networks(CNNs)for breast cancer axillary lymph node(ALN)images have focused on large sample analysis and clinical parameter integration,while limited attention has been paid to lightweight models for small ALN datasets.In this paper,we have selected a small number of ALN ultrasound image datasets as the research subject and designed a TX-GGCA model,consisting of the Tiny-Xception model and the global grouping coordinate attention(GGCA).The TX-GGCA demonstrated an accuracy of 99.14%and an area under curve(AUC)of 0.9997 in classifying normal and abnormal ALN images,outperforming the best traditional model(accuracy:95.69%,AUC:0.9932).It showed the potential value of this model for clinical diagnosis in primary hospitals with limited sample sizes.展开更多
Deep learning(DL),especially convolutional neural networks(CNNs),has been widely applied in air handling unit(AHU)fault diagnosis(FD).However,its application faces two major challenges.Firstly,the accessibility of ope...Deep learning(DL),especially convolutional neural networks(CNNs),has been widely applied in air handling unit(AHU)fault diagnosis(FD).However,its application faces two major challenges.Firstly,the accessibility of operational state variables for AHU systems is limited in practical,and the effectiveness and applicability of existing DL methods for diagnosis require further validation.Secondly,the interpretability performance of DL models under various information scenarios needs further exploration.To address these challenges,this study utilized publicly available ASHRAE RP-1312 AHU fault data and employed CNNs to construct three FD models under three various information scenarios.Furthermore,the layer-wise relevance propagation(LRP)method was used to interpret and explain the effects of these three various information scenarios on the CNN models.An R-threshold was proposed to systematically differentiate diagnostic criteria,which further elucidates the intrinsic reasons behind correct and incorrect decisions made by the models.The results showed that the CNN-based diagnostic models demonstrated good applicability under the three various information scenarios,with an average diagnostic accuracy of 98.55%.The LRP method provided good interpretation and explanation for understanding the decision mechanism of CNN models for the unlimited information scenarios.For the very limited information scenario,since the variables are restricted,although LRP can reveal key variables in the model’s decision-making process,these key variables have certain limitations in terms of data and physical explanations for further improving the model’s interpretation.Finally,an in-depth analysis of model parameters—such as the number of convolutional layers,learning rate,βparameters,and training set size—was conducted to examine their impact on the interpretative results.This study contributes to clarifying the effects of various information scenarios on the diagnostic performance and interpretability of LRP-based CNN models for AHU FD,which helps provide improved reliability of DL models in practical applications.展开更多
基金by Chengdu Science and Technology Program(2026-YF08-00034-GX).
摘要Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.
基金supported by State Grid Corporation Limited Science and Technology Project Funding(Contract No.SGCQSQ00YJJS2200380).
摘要There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capacitor components showa continuous and stable charging and discharging state,a hierarchical time-sharing configuration algorithm of distributed energy storage cloud group end region on the power grid side based on multi-scale and multi feature convolution neural network is proposed.Firstly,a voltage stability analysis model based onmulti-scale and multi feature convolution neural network is constructed,and the multi-scale and multi feature convolution neural network is optimized based on Self-OrganizingMaps(SOM)algorithm to analyze the voltage stability of the cloud group end region of distributed energy storage on the grid side under the framework of credibility.According to the optimal scheduling objectives and network size,the distributed robust optimal configuration control model is solved under the framework of coordinated optimal scheduling at multiple time scales;Finally,the time series characteristics of regional power grid load and distributed generation are analyzed.According to the regional hierarchical time-sharing configuration model of“cloud”,“group”and“end”layer,the grid side distributed energy storage cloud group end regional hierarchical time-sharing configuration algorithm is realized.The experimental results show that after applying this algorithm,the best grid side distributed energy storage configuration scheme can be determined,and the stability of grid side distributed energy storage cloud group end region layered timesharing configuration can be improved.
摘要Alzheimer’s disease(AD)is a neurological disorder that predominantly affects the brain.In the coming years,it is expected to spread rapidly,with limited progress in diagnostic techniques.Various machine learning(ML)and artificial intelligence(AI)algorithms have been employed to detect AD using single-modality data.However,recent developments in ML have enabled the application of these methods to multiple data sources and input modalities for AD prediction.In this study,we developed a framework that utilizes multimodal data(tabular data,magnetic resonance imaging(MRI)images,and genetic information)to classify AD.As part of the pre-processing phase,we generated a knowledge graph from the tabular data and MRI images.We employed graph neural networks for knowledge graph creation,and region-based convolutional neural network approach for image-to-knowledge graph generation.Additionally,we integrated various explainable AI(XAI)techniques to interpret and elucidate the prediction outcomes derived from multimodal data.Layer-wise relevance propagation was used to explain the layer-wise outcomes in the MRI images.We also incorporated submodular pick local interpretable model-agnostic explanations to interpret the decision-making process based on the tabular data provided.Genetic expression values play a crucial role in AD analysis.We used a graphical gene tree to identify genes associated with the disease.Moreover,a dashboard was designed to display XAI outcomes,enabling experts and medical professionals to easily comprehend the predic-tion results.
基金the Innovation Action Plan Foundation of Shanghai(No.16511101200)
摘要Convolutional neural networks (CNNs) have been applied in state-of-the-art visual tracking tasks to represent the target. However, most existing algorithms treat visual tracking as an object-specific task. Therefore, the model needs to be retrained for different test video sequences. We propose a branch-activated multi-domain convolutional neural network (BAMDCNN). In contrast to most existing trackers based on CNNs which require frequent online training, BAMDCNN only needs offine training and online fine-tuning. Specifically, BAMDCNN exploits category-specific features that are more robust against variations. To allow for learning category-specific information, we introduce a group algorithm and a branch activation method. Experimental results on challenging benchmark show that the proposed algorithm outperforms other state-of-the-art methods. What's more, compared with CNN based trackers, BAMDCNN increases tracking speed.
基金funded by the National Natural Science Foundation of China(52577115)Education Research Project for Young and Middle-Aged Teachers of Fujian Provincial Education Department(JAT251119)Startup Fund for Advanced Talents of Putian University(2023133).
摘要Accurate building electricity load forecasting(BELF)can provide a regulatory basis for building energy management systems and promote the transition of buildings toward low-carbon and intelligent operation modes.However,building electricity load is influenced by historical loads,as well as outside environmental conditions such as humidity and temperature,which reduces the prediction accuracy of models.To tackle these challenges,this study presents a BELF model,which consists of a modal component grouping approach,grouped feature attention mechanism,and multi-scale residual depthwise convolution memory module.First,the modal component grouping method analyzes building electricity load in the time domain,frequency domain(via fast fourier transform,FFT),and complexity(via sample entropy,SE),and then performs clustering to achieve precise decomposition of load components with different fluctuation characteristics.Second,the grouped feature attention mechanism assigns suitable importance to various input features to emphasize key factors affecting prediction accuracy.Third,the multi-scale residual depthwise convolution memory module mitigates the impact of long and short-term load variations on BELF by employing residual blocks of depthwise convolution layers with different kernel sizes.Meanwhile,gated recurrent units are used to identify the time-dependent trends of building load.Experimental results on public buildings show that the proposed model outperforms existing models,achieving more than 2.4%improvement in MAPE prediction performance.
基金supported by the Establishment of Key Laboratory of Shenzhen Science and Technology Innovation Committee under Grant No.ZDSYS20190902093015527the Shenzhen Science and Technology Innovation Committee under Grant No.JSGG20220831104402004。
摘要Extracting spatio-temporal cues from neighbouring frames is challenging in video super-resolution(VSR).Although deformable alignment-based VSR methods have shown promise in aligning neighbouring frames with the reference frame,most existing methods rely on one or a few traditional convolutions to estimate motion offsets for spatio-temporal alignment,restricting receptive field size and alignment accuracy.To address these limitations,we propose an effective spatio-temporal alignment network(ESTA-Net)for VSR.The core component of our method is the group convolution-based alignment module(GCBAM),which utilises cascaded group convolutions to learn offsets across both the original and downsampled resolutions.By employing group convolutions rather than traditional convolutions,GCBAM enables the deformable alignment to achieve a wider receptive field with lower computational cost,thereby improving the accuracy of offset estimation.Additionally,the bi-scale alignment strategy within GCBAM enhances robustness to complex and large-scale motions.Furthermore,we introduce an attention-based feature enhancement module(AFEM)to refine the aligned features,focusing on critical details to improve reconstruction quality.Extensive experiments on standard benchmarks show that our ESTA-Net achieves superior VSR performance against other advanced methods,while maintaining a good equilibrium between model size and performance.
基金funded by the National Natural Science Foundation of China under Grant No.62371187the Open Program of Hunan Intelligent Rehabilitation Robot and Auxiliary Equipment Engineering Technology Research Center under Grant No.2024JS101.
摘要The ubiquity of mobile devices has driven advancements in mobile object detection.However,challenges in multi-scale object detection in open,complex environments persist due to limited computational resources.Traditional approaches like network compression,quantization,and lightweight design often sacrifice accuracy or feature representation robustness.This article introduces the Fast Multi-scale Channel Shuffling Network(FMCSNet),a novel lightweight detection model optimized for mobile devices.FMCSNet integrates a fully convolutional Multilayer Perceptron(MLP)module,offering global perception without significantly increasing parameters,effectively bridging the gap between CNNs and Vision Transformers.FMCSNet achieves a delicate balance between computation and accuracy mainly by two key modules:the ShiftMLP module,including a shift operation and an MLP module,and a Partial group Convolutional(PGConv)module,reducing computation while enhancing information exchange between channels.With a computational complexity of 1.4G FLOPs and 1.3M parameters,FMCSNet outperforms CNN-based and DWConv-based ShuffleNetv2 by 1%and 4.5%mAP on the Pascal VOC 2007 dataset,respectively.Additionally,FMCSNet achieves a mAP of 30.0(0.5:0.95 IoU threshold)with only 2.5G FLOPs and 2.0M parameters.It achieves 32 FPS on low-performance i5-series CPUs,meeting real-time detection requirements.The versatility of the PGConv module’s adaptability across scenarios further highlights FMCSNet as a promising solution for real-time mobile object detection.
基金supported by the Key Scientific Research Project of Hunan Education Department,China(Nos.23A0446 and 22A0414)the Natural Science Foundation of Hunan Province,China(Provinces and Cities Combined)(Nos.2022JJ50067,2024JJ7654,and 2024JJ7149)。
摘要Many studies based on convolutional neural networks(CNNs)for breast cancer axillary lymph node(ALN)images have focused on large sample analysis and clinical parameter integration,while limited attention has been paid to lightweight models for small ALN datasets.In this paper,we have selected a small number of ALN ultrasound image datasets as the research subject and designed a TX-GGCA model,consisting of the Tiny-Xception model and the global grouping coordinate attention(GGCA).The TX-GGCA demonstrated an accuracy of 99.14%and an area under curve(AUC)of 0.9997 in classifying normal and abnormal ALN images,outperforming the best traditional model(accuracy:95.69%,AUC:0.9932).It showed the potential value of this model for clinical diagnosis in primary hospitals with limited sample sizes.
基金supported by the Opening Fund of Key Laboratory of Low-grade Energy Utilization Technologies and Systems of Ministry of Education of China(Chongqing University)(No.LLEUTS-202305)the National Natural Science Foundation of China(No.51906181)+4 种基金the Youth Innovation Technology Project of Higher School in Shandong Province(No.2022KJ204)“The 14th Five Year Plan”Hubei Provincial advantaged characteristic disciplines(groups)project of Wuhan University of Science and Technology(No.2023D0504,No.2023D0501)the Opening Fund of State Key Laboratory of Green Building in Western China(No.LSKF202316)Hubei Undergraduate Training Program for Innovation and Entrepreneurship(No.S202210488076)the Wuhan University of Science and Technology Postgraduate Innovation and Entrepreneurship Fund(JCX2023026).
摘要Deep learning(DL),especially convolutional neural networks(CNNs),has been widely applied in air handling unit(AHU)fault diagnosis(FD).However,its application faces two major challenges.Firstly,the accessibility of operational state variables for AHU systems is limited in practical,and the effectiveness and applicability of existing DL methods for diagnosis require further validation.Secondly,the interpretability performance of DL models under various information scenarios needs further exploration.To address these challenges,this study utilized publicly available ASHRAE RP-1312 AHU fault data and employed CNNs to construct three FD models under three various information scenarios.Furthermore,the layer-wise relevance propagation(LRP)method was used to interpret and explain the effects of these three various information scenarios on the CNN models.An R-threshold was proposed to systematically differentiate diagnostic criteria,which further elucidates the intrinsic reasons behind correct and incorrect decisions made by the models.The results showed that the CNN-based diagnostic models demonstrated good applicability under the three various information scenarios,with an average diagnostic accuracy of 98.55%.The LRP method provided good interpretation and explanation for understanding the decision mechanism of CNN models for the unlimited information scenarios.For the very limited information scenario,since the variables are restricted,although LRP can reveal key variables in the model’s decision-making process,these key variables have certain limitations in terms of data and physical explanations for further improving the model’s interpretation.Finally,an in-depth analysis of model parameters—such as the number of convolutional layers,learning rate,βparameters,and training set size—was conducted to examine their impact on the interpretative results.This study contributes to clarifying the effects of various information scenarios on the diagnostic performance and interpretability of LRP-based CNN models for AHU FD,which helps provide improved reliability of DL models in practical applications.