Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighb...Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighbor aggregation are fixed, leading to the limited capability of capturing diverse relationships among nodes for representation learning. Conventional GCNs always learn node representations in the graph according to the weights computed from the graph Laplacian, consequently overlooking the similarity and group cohesiveness of node features.展开更多
Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and com...Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and computational costs from calculating correlations between all tokens(especially as image size or spectral bands increase)and limited ability to model local boundary information due to lacking explicit enhancement mechanisms.This paper proposes a novel method,bridge transformer network fused with deep graph convolution(BTDGC),to address these issues.The framework includes three components as follows:a double random masking mechanism(DRMM)that forces the model to infer masked features from context during training,a bridge transformer(BT)module with bridge tokens for cross-region feature interaction and a Deep Graph Convolutional Pooling(DGCP)module that preserves spatial topology while aggregating hierarchical information.Experiments on standard hyperspectral datasets show BTDGC outperforms mainstream methods in classification accuracy and robustness,effectively balancing global modelling and local boundary representation.The code is available at http://gffzz188fe103f8f1460aswqwwf9oxbqc96kwp.ffgz.tsg.suse.edu.cn/jenny3489/BTDGC.展开更多
Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representat...Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representations across diverse real-world applications.展开更多
Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating In...Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating Interactive Dynamic Graph Convolution Network(IDGCN)with Temporal Multi-Head Trend-Aware Attention.Its core innovation lies in IDGCN,which uniquely splits sequences into symmetric intervals for interactive feature sharing via dynamic graphs,and a novel attention mechanism incorporating convolutional operations to capture essential local traffic trends—addressing a critical gap in standard attention for continuous data.For 15-and 60-min forecasting on METR-LA,AIDGCN achieves MAEs of 0.75%and 0.39%,and RMSEs of 1.32%and 0.14%,respectively.In the 60-min long-term forecasting of the PEMS-BAY dataset,the AIDGCN out-performs the MRA-BGCN method by 6.28%,4.93%,and 7.17%in terms of MAE,RMSE,and MAPE,respectively.Experimental results demonstrate the superiority of our pro-posed model over state-of-the-art methods.展开更多
Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models ...Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.展开更多
Dear Editor,The letter proposes a tensor low-rank orthogonal compression(TLOC)model for a convolutional neural network(CNN),which facilitates its efficient and highly-accurate low-rank representation.Model compression...Dear Editor,The letter proposes a tensor low-rank orthogonal compression(TLOC)model for a convolutional neural network(CNN),which facilitates its efficient and highly-accurate low-rank representation.Model compression is crucial for deploying deep neural network(DNN)models on resource-constrained embedded devices.展开更多
Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-...Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-attention modeling of global temporal dependency has problems of high computational overhead and feature similarity.On the other hand,fixed-size convolution kernels are often used,which have weak perception ability for emotional regions of different scales.Therefore,this paper proposes a video emotion recognition model that combines multi-scale region-aware convolution with temporal interactive sampling.In terms of space,multi-branch large-kernel stripe convolution is used to perceive emotional region features at different scales,and attention weights are generated for each scale feature.In terms of time,multi-layer odd-even down-sampling is performed on the time series,and oddeven sub-sequence interaction is performed to solve the problem of feature similarity,while reducing computational costs due to the linear relationship between sampling and convolution overhead.This paper was tested on CMU-MOSI,CMU-MOSEI,and Hume Reaction.The Acc-2 reached 83.4%,85.2%,and 81.2%,respectively.The experimental results show that the model can significantly improve the accuracy of emotion recognition.展开更多
Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal f...Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal features,particularly in capturing temporal periodicity and spatial dependency in dynamically evolving traffic networks.This paper proposes a novel framework of traffic flow prediction,referred to as Adaptive Graph Fusion Dual-scale Convolutional Network(AGFDCN),which integrates spatial-temporal dynamic graphs with dual-scale convolutional networks.Specifically,we introduce a Dual-Scale Temporal Network,which combines long-and short-term dilated causal convolutions with a temporal decay-aware attention mechanism to efficiently capture traffic patterns across multiple temporal scales.Furthermore,we design a Dynamic Adaptive Graph Module,which models complex spatial dependencies in traffic networks through an adaptive graph fusion mechanism and a dual-path attention-gated module.Finally,the temporal and spatial representations are integrated by employing a gated fusion mechanism,enhancing the overall prediction performance.Experimental results obtained based on three highway datasets(i.e.,PEMS04,PEMS07 and PEMS08)verify that the proposed model outperforms several state-of-the-art baselines in various evaluation metrics.Compared to the spatial-temporal graph model AGCRN with best performance in the baseline models,the proposed model exhibits significant improvements across all datasets:it achieves reduces of MAE by 42.07%and RMSE by 35.43%on PEMS04;MAE by 28.35%and RMSE by 29.28%on PEMS07;and MAE by 30.52%and RMSE by 30.73%on PEMS08,respectively,validating its effectiveness in modeling complex spatial-temporal traffic data and its robustness in handling sudden traffic changes.展开更多
Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields base...Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields based on genetic algorithms and convolutional neural networks(CNNs).The magnetic probe position matrix of the traditional equivalent source is utilized as input,and the three-directional components of the magnetic field measured by the probes are employed as output.The extrapolation model for ship magnetic fields is obtained through iterative training and fitting with CNNs.Variables such as the number of magnetic dipoles,the distance between magnetic dipoles,the size and quantity of convolutional kernels,batch size,learning rate,and L2 regularization coefficient are optimized to boost the accuracy of the extrapolation model for magnetic fields.The fitting accuracy of the extrapolation model for ship magnetic fields is used as the optimization objective.Based on a finite element simulation model of ship magnetic fields,the accuracy and robustness of the CNN algorithm under different magnetic field conditions are validated using the known standard depth plane,the unknown depth at 1.125 times the standard depth plane,and the unknown depth at 1.25 times the standard depth plane.Results show that,after optimization,the fitting error for the magnetic field extrapolation model based on CNN is 1.50%for the standard depth plane,1.63%for the unknown depth at 1.125 times the standard depth plane,and 2.36%for the unknown depth at 1.25 times the standard depth plane.The error remains below 5%under varying magnetic field conditions.When a random measurement error of 0%-5%is introduced for the magnetic probes,the prediction error at 1.25 times the standard depth plane is 2.30%;with a random error of 0%-10%,the prediction error is 4.95%.This approach significantly improves the accuracy and robustness of magnetic field extrapolation,which makes it an effective and feasible method for ship magnetic field modeling.展开更多
The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate cha...The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate change.We applied the Spatiotemporal Convolutional Long Short-Term Memory(STConvLSTM)model,integrating key environmental factors including sea surface temperature(SST),sea surface salinity(SSS),and chlorophyll a(Chl a),to predict and analyze sea surface pCO2in the South China Sea.The model demonstrated high accuracy in short-term predictions(1 month),with a mean absolute error(MAE)of 0.394,a root mean square error(RMSE)of 0.659,and a coefficient of determination(R2)of 0.998.For long-term predictions(12 months),the model maintained its predictive capability,with an MAE of 0.667,RMSE of 1.255,and R2of 0.994.Feature importance analysis revealed that sea surface pCO2and SST were the main drivers of the model’s predictions,whereas Chl a and SSS had relatively minor impacts.The model’s generalization ability was further validated in the northwest Pacific Ocean and tropical Pacific Ocean,where it successfully captured the spatiotemporal variation in pCO2with small prediction errors.The ST-ConvLSTM model provides an efficient and accurate tool for forecasting and analyzing sea surface pCO2in the South China Sea,offering new insights into global carbon cycling and climate change.This study demonstrates the potential of deep learning in marine science and provides a significant technical support for global changes and marine ecosystem research.展开更多
Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The ...Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The multi-source perception data obtained thereby can provide a complete digital representation of the road network for the Intelligent Transportation System(ITS).However,sensors are vulnerable to environmental interference,which can result in data loss at specific points or along arterial highways for certain periods,potentially undermining system safety and decision-making reliability.To address these challenges,a deep learning method based on Graph Convolutional Networks(GCN)and Gated Recurrent Units(GRU)is proposed,leveraging Artificial Intelligence(AI)and intelligent connected technologies for real-time acquisition of multi-sensor perception data.A feature-level fusion integrates multi-source perception data.GCN captures spatial dependencies from the road network topology,while GRU extracts temporal features from time series,enabling accurate imputation of missing traffic data.The method is evaluated at intelligent connected intersections in the Beijing High-level Autonomous Driving Demonstration Area.Results show that the accuracy of long-term traffic state completion reaches 89.36%,and the Root Mean Square Error(RMSE)is reduced by 17.2%compared to the Long Short-Term Memory(LSTM)baseline.This framework provides a practical solution for deploying traffic holographic perception technology in secure and trustworthy ITS.展开更多
Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient im...Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient image captioning model named Mob-IMWTC,which integrates improved wavelet convolution(IMWTC)with an enhanced MobileNet V3 architecture.The enhanced MobileNet V3 integrates a transformer encoder as its encoding module and a transformer decoder as its decoding module.This innovative neural network significantly reduces the memory space required and model training time,while maintaining a high level of accuracy in generating image descriptions.IMWTC facilitates large receptive fields without significantly increasing the number of parameters or computational overhead.The improvedMobileNet V3 model has its classifier removed,and simultaneously,it employs IMWTC layers to replace the original convolutional layers.This makes Mob-IMWTC exceptionally well-suited for deployment on lowresource devices.Experimental results,based on objective evaluation metrics such as BLEU,ROUGE,CIDEr,METEOR,and SPICE,demonstrate that Mob-IMWTC outperforms state-of-the-art models,including three CNN architectures(CNN-LSTM,CNN-Att-LSTM,CNN-Tran),two mainstream methods(LCM-Captioner,ClipCap),and our previous work(Mob-Tran).Subjective evaluations further validate the model’s superiority in terms of grammaticality,adequacy,logic,readability,and humanness.Mob-IMWTC offers a lightweight yet effective solution for image captioning,making it suitable for deployment on resource-constrained devices.展开更多
Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using d...Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.展开更多
Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empir...Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empirical achievements.In this paper,the first filter learning framework with convergence-guaranteed learning laws for end-to-end learning of deep CNNs is proposed.Novel update laws with convergence analysis are formulated based on the mathematical representation of each layer in convolutional neural networks.The proposed learning laws enable concurrent updates of weights across all layers of the deep convolutional neural network and the analysis shows that the training errors converge to certain bounds which are dependent on the approximation errors.Case studies are conducted on benchmark datasets and the results show that the proposed concurrent filter learning framework guarantees the convergence and offers more consistent and reliable results during training with a trade-off in performance compared to stochastic gradient descent methods.This framework represents a significant step towards enhancing the reliability and effectiveness of deep convolutional neural network by developing a theoretical analysis which allows practical implementation of the learning laws with automatic tuning of the learning rate to guarantee the convergence during training.展开更多
Accurate and quick diagnosis of COVID-19 remains a global challenge,as conventional RT-PCR testing suffers from high false-negative rates,delays,and limited availability.Chest X-ray imaging,while more accessible,requi...Accurate and quick diagnosis of COVID-19 remains a global challenge,as conventional RT-PCR testing suffers from high false-negative rates,delays,and limited availability.Chest X-ray imaging,while more accessible,requires expert interpretation and is prone to human error.Although several deep learning methods have been applied,many face issues of overfitting,insufficient feature selection,and reduced reliability.In order to overcome these constraints,we suggest a hybrid framework,COVID-19-DSCNN-XISSP,which integrates a Deep Spatial Convolutional Neural Network(DSCNN)for robust spatial excision of features with the Exponential Incremental Social Ski Driver with Sine Cosine Algorithm(XISSP)for optimal feature selection.This strategy enhances classification accuracy while reducing computational overhead.Extensive experiments on benchmark COVID-19 chest X-ray datasets demonstrate that the proposed model outperforms existing approaches in terms of accuracy,precision,and robustness.The findings highlight the potential of COVID-19-DSCNN-XISSP as an economical,automated,and expandable tool for assisting radiologists in early and reliable detection of COVID-19,thereby supporting improved clinical decision-making and pandemic control.展开更多
In contemporary computer vision,convolutional neural networks(CNNs)and vision transformers(ViTs)represent the two primary architectural paradigms for image recognition.While both approaches have been widely adopted in...In contemporary computer vision,convolutional neural networks(CNNs)and vision transformers(ViTs)represent the two primary architectural paradigms for image recognition.While both approaches have been widely adopted in medical imaging applications,they operate based on fundamentally different computational principles.This report attempts to provide brief application notes on ViTs and CNNs,particularly focusing on scenarios that guide the selection of one architecture over the other in practical medical implementations.Generally,CNNs rely on convolutional kernels,localized receptive fields,and weight sharing,enabling efficient hierarchical feature extraction.These properties contribute to strong performance in detecting spatially constrained patterns such as textures,edges,and anatomical boundaries,while maintaining relatively low computational requirements.ViTs,on the other hand,decompose images into smaller segments referred to as tokens and employ self-attention mechanisms to model relationships across the entire image.This global modeling capability allows ViTs to capture long-range dependencies that may be difficult for convolution-based architectures to learn.However,ViTs typically achieve optimal performance when trained on extremely large datasets or when supported by extensive pretraining,as their reduced inductive bias requires greater data exposure to learn robust representations.This report briefly examines the architectural structure,underlying mathematical foundations,and relative performance characteristics of CNNs and ViTs,drawing upon recent findings from contemporary research.Emphasis is placed on understanding how differences in data availability,computational resources,and task requirements influence model effectiveness across medical imaging domains.Most importantly,the report serves as a concise application guide for practitioners seeking informed implementation decisions between these two influential deep learning frameworks.展开更多
Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on li...Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on linear processes,leading to poor performance in dynamic nonlinear processes.In this paper,a novel quality-related fault detection method,named DiCAE-PLS,is developed by combining dynamic-inner convolutional autoencoder with PLS.In the proposed DiCAE-PLS method,latent features are first extracted through dynamic-inner convolutional autoencoder (DiCAE) to capture process dynamics and nonlinearity from process variables.Then,a PLS model is established to build the relationship between the extracted latent features and the final product quality.To detect quality-related faults,Hotelling's T2 statistic is employed.The developed quality-related fault detection is applied to the widely used industrial benchmark of the Tennessee.展开更多
With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance s...With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.展开更多
Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecon...Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecond pulses,and the prevailing approach involves utilizing attosecond streak cameras coupled with inversion algorithms to reconstruct phase information.However,these algorithms often require multiple iterations and extensive computational time.This study investigates the utilization of autocorrelation graphs as inputs for a convolutional neural network(CNN)to invert streaking traces obtained by attosecond streak camera.We explore the noise resistance capability of autocorrelation within the CNN inversion and aim to provide a physical explanation for its effectiveness.The objective of this research is to enhance the accuracy and reliability of CNN inversion for attosecond streaking traces,enabling improved resilience against experimental noises.展开更多
Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relati...Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relationships among nodes.This paper proposes a novel graph coupling convolutional model that introduces an adaptive weighting mechanism to assign distinct importance to neighboring nodes based on their similarity to the central node.Unlike traditional methods,the proposed coupling strategy enhances the interpretability of node interactions while maintaining competitive classification performance.The model operates in the spatial domain,utilizing adjacency list structures for efficient convolution and addressing the limitations of weight sharing through a coupling-based similarity computation.Extensive experiments are conducted on five graph-structured datasets,including Cora,Citeseer,PubMed,Reddit,and BlogCatalog,as well as a custom topology dataset constructed from the Open University Learning Analytics Dataset(OULAD)educational platform.Results demonstrate that the proposed model achieves good classification accuracy,while significantly reducing training time through direct second-order neighbor fusion and data preprocessing.Moreover,analysis of neighborhood order reveals that considering third-order neighbors offers limited accuracy gains but introduces considerable computational overhead,confirming the efficiency of first-and second-order convolution in practical applications.Overall,the proposed graph coupling model offers a lightweight,interpretable,and effective framework for multi-label node classification in complex networks.展开更多
摘要Dear Editor,This letter presents a novel graph neural network, namely modularized graph convolution network(MGCN), to address the underexplored issue in graph convolution networks(GCNs), wherein the weights for neighbor aggregation are fixed, leading to the limited capability of capturing diverse relationships among nodes for representation learning. Conventional GCNs always learn node representations in the graph according to the weights computed from the graph Laplacian, consequently overlooking the similarity and group cohesiveness of node features.
摘要Transformers have been widely applied to hyperspectral image classification,leveraging their self-attention mechanism for powerful global modelling.However,two key challenges remain as follows:excessive memory and computational costs from calculating correlations between all tokens(especially as image size or spectral bands increase)and limited ability to model local boundary information due to lacking explicit enhancement mechanisms.This paper proposes a novel method,bridge transformer network fused with deep graph convolution(BTDGC),to address these issues.The framework includes three components as follows:a double random masking mechanism(DRMM)that forces the model to infer masked features from context during training,a bridge transformer(BT)module with bridge tokens for cross-region feature interaction and a Deep Graph Convolutional Pooling(DGCP)module that preserves spatial topology while aggregating hierarchical information.Experiments on standard hyperspectral datasets show BTDGC outperforms mainstream methods in classification accuracy and robustness,effectively balancing global modelling and local boundary representation.The code is available at http://gffzz188fe103f8f1460aswqwwf9oxbqc96kwp.ffgz.tsg.suse.edu.cn/jenny3489/BTDGC.
基金supported by the National Natural Science Foundation of China(62402399)the New Chongqing Youth Innovation Talent Project(CSTB2024NSCQ-QCXMX0035)。
摘要Dear Editor,D2This letter presents a node feature similarity preserving graph convolutional framework P G.Graph neural networks(GNNs)have garnered significant attention for their efficacy in learning graph representations across diverse real-world applications.
摘要Reliable traffic flow prediction is crucial for mitigating urban congestion.This paper proposes Attentionbased spatiotemporal Interactive Dynamic Graph Convolutional Network(AIDGCN),a novel architecture integrating Interactive Dynamic Graph Convolution Network(IDGCN)with Temporal Multi-Head Trend-Aware Attention.Its core innovation lies in IDGCN,which uniquely splits sequences into symmetric intervals for interactive feature sharing via dynamic graphs,and a novel attention mechanism incorporating convolutional operations to capture essential local traffic trends—addressing a critical gap in standard attention for continuous data.For 15-and 60-min forecasting on METR-LA,AIDGCN achieves MAEs of 0.75%and 0.39%,and RMSEs of 1.32%and 0.14%,respectively.In the 60-min long-term forecasting of the PEMS-BAY dataset,the AIDGCN out-performs the MRA-BGCN method by 6.28%,4.93%,and 7.17%in terms of MAE,RMSE,and MAPE,respectively.Experimental results demonstrate the superiority of our pro-posed model over state-of-the-art methods.
基金by Chengdu Science and Technology Program(2026-YF08-00034-GX).
摘要Hybrid CNN-Transformer models are widely used in medical image segmentation because they combine CNN-based local feature extraction with Transformer-based global context modeling.Despite their popularity,these models face several challenges,including computational complexity,noise blurring,and information loss.This paper proposes an enhanced convolutional attention network(ECANet)for liver segmentation.ECANet uses a U-shaped architecture with efficient channel-attention-based skip connections.Both the encoder and decoder are constructed using enhanced convolutional Transformer(ECT)blocks,where group convolution is integrated into the convolutional attention module for efficient Token embedding and channel disentanglement,and a Token-wise multi-layer perceptron(MLP)branch is incorporated into the wide-focus module to improve feature representation across channels.Deep supervision and a hybrid of Binary Cross-Entropy(BCE)and Dice loss are used to improve boundary accuracy.We evaluate the proposed model on the publicly available LiTS17 dataset.Experiments show that ECANet outperforms the compared CNN-based and CNN-Transformer baseline models on both quantitative and qualitative measures.
基金supported by the Science and Technology Innovation Key R&D Program of Chongqing(CSTB2025TIAD-STX0032)National Key Research and Development Program of China(2024YFF0908200)+1 种基金the Chongqing Technology Innovation and Application Development Special Key Project(CSTB2024TIAD-KPX0018)the Southwest University Graduate Student Research Innovation(SWUB24051)。
摘要Dear Editor,The letter proposes a tensor low-rank orthogonal compression(TLOC)model for a convolutional neural network(CNN),which facilitates its efficient and highly-accurate low-rank representation.Model compression is crucial for deploying deep neural network(DNN)models on resource-constrained embedded devices.
基金supported,in part,by the National Nature Science Foundation of China under Grant 62272236,62376128in part,by the Natural Science Foundation of Jiangsu Province under Grant BK20201136,BK20191401.
摘要Video emotion recognition is widely used due to its alignment with the temporal characteristics of human emotional expression,but existingmodels have significant shortcomings.On the one hand,Transformermultihead self-attention modeling of global temporal dependency has problems of high computational overhead and feature similarity.On the other hand,fixed-size convolution kernels are often used,which have weak perception ability for emotional regions of different scales.Therefore,this paper proposes a video emotion recognition model that combines multi-scale region-aware convolution with temporal interactive sampling.In terms of space,multi-branch large-kernel stripe convolution is used to perceive emotional region features at different scales,and attention weights are generated for each scale feature.In terms of time,multi-layer odd-even down-sampling is performed on the time series,and oddeven sub-sequence interaction is performed to solve the problem of feature similarity,while reducing computational costs due to the linear relationship between sampling and convolution overhead.This paper was tested on CMU-MOSI,CMU-MOSEI,and Hume Reaction.The Acc-2 reached 83.4%,85.2%,and 81.2%,respectively.The experimental results show that the model can significantly improve the accuracy of emotion recognition.
基金supported in part by the National Nature Science Foundation of China under Grants 62476216 and 62006184in part by the Key Research and Development Program of Shaanxi Province under Grant 2024GX-YBXM-146+1 种基金in part by the Scientific Research ProgramFunded by EducationDepartment of the Shaanxi Provincial Government under Grant 23JP091the Youth Innovation Team of Shaanxi Universities.
摘要Traffic flow prediction is of great importance in traffic planning,road resource management,and congestion mitigation.However,existing prediction have significant limitations in modeling multi-scale spatial-temporal features,particularly in capturing temporal periodicity and spatial dependency in dynamically evolving traffic networks.This paper proposes a novel framework of traffic flow prediction,referred to as Adaptive Graph Fusion Dual-scale Convolutional Network(AGFDCN),which integrates spatial-temporal dynamic graphs with dual-scale convolutional networks.Specifically,we introduce a Dual-Scale Temporal Network,which combines long-and short-term dilated causal convolutions with a temporal decay-aware attention mechanism to efficiently capture traffic patterns across multiple temporal scales.Furthermore,we design a Dynamic Adaptive Graph Module,which models complex spatial dependencies in traffic networks through an adaptive graph fusion mechanism and a dual-path attention-gated module.Finally,the temporal and spatial representations are integrated by employing a gated fusion mechanism,enhancing the overall prediction performance.Experimental results obtained based on three highway datasets(i.e.,PEMS04,PEMS07 and PEMS08)verify that the proposed model outperforms several state-of-the-art baselines in various evaluation metrics.Compared to the spatial-temporal graph model AGCRN with best performance in the baseline models,the proposed model exhibits significant improvements across all datasets:it achieves reduces of MAE by 42.07%and RMSE by 35.43%on PEMS04;MAE by 28.35%and RMSE by 29.28%on PEMS07;and MAE by 30.52%and RMSE by 30.73%on PEMS08,respectively,validating its effectiveness in modeling complex spatial-temporal traffic data and its robustness in handling sudden traffic changes.
摘要Accurate modeling of ship magnetic fields is important for predicting their spatial distribution to improve the magnetic stealth effect of ships.This study proposes an extrapolation model for ship magnetic fields based on genetic algorithms and convolutional neural networks(CNNs).The magnetic probe position matrix of the traditional equivalent source is utilized as input,and the three-directional components of the magnetic field measured by the probes are employed as output.The extrapolation model for ship magnetic fields is obtained through iterative training and fitting with CNNs.Variables such as the number of magnetic dipoles,the distance between magnetic dipoles,the size and quantity of convolutional kernels,batch size,learning rate,and L2 regularization coefficient are optimized to boost the accuracy of the extrapolation model for magnetic fields.The fitting accuracy of the extrapolation model for ship magnetic fields is used as the optimization objective.Based on a finite element simulation model of ship magnetic fields,the accuracy and robustness of the CNN algorithm under different magnetic field conditions are validated using the known standard depth plane,the unknown depth at 1.125 times the standard depth plane,and the unknown depth at 1.25 times the standard depth plane.Results show that,after optimization,the fitting error for the magnetic field extrapolation model based on CNN is 1.50%for the standard depth plane,1.63%for the unknown depth at 1.125 times the standard depth plane,and 2.36%for the unknown depth at 1.25 times the standard depth plane.The error remains below 5%under varying magnetic field conditions.When a random measurement error of 0%-5%is introduced for the magnetic probes,the prediction error at 1.25 times the standard depth plane is 2.30%;with a random error of 0%-10%,the prediction error is 4.95%.This approach significantly improves the accuracy and robustness of magnetic field extrapolation,which makes it an effective and feasible method for ship magnetic field modeling.
基金Supported by the National Key Research and Development Program of China(No.2023YFC3008202)the National Natural Science Foundation of China(No.42406019)the Scientific Research Fund of Zhejiang Provincial Education Department(No.Y202353066)。
摘要The prediction of sea surface partial pressure of carbon dioxide(pCO2)in the South China Sea is crucial for understanding the region’s contribution to the global carbon budget and its interactions with climate change.We applied the Spatiotemporal Convolutional Long Short-Term Memory(STConvLSTM)model,integrating key environmental factors including sea surface temperature(SST),sea surface salinity(SSS),and chlorophyll a(Chl a),to predict and analyze sea surface pCO2in the South China Sea.The model demonstrated high accuracy in short-term predictions(1 month),with a mean absolute error(MAE)of 0.394,a root mean square error(RMSE)of 0.659,and a coefficient of determination(R2)of 0.998.For long-term predictions(12 months),the model maintained its predictive capability,with an MAE of 0.667,RMSE of 1.255,and R2of 0.994.Feature importance analysis revealed that sea surface pCO2and SST were the main drivers of the model’s predictions,whereas Chl a and SSS had relatively minor impacts.The model’s generalization ability was further validated in the northwest Pacific Ocean and tropical Pacific Ocean,where it successfully captured the spatiotemporal variation in pCO2with small prediction errors.The ST-ConvLSTM model provides an efficient and accurate tool for forecasting and analyzing sea surface pCO2in the South China Sea,offering new insights into global carbon cycling and climate change.This study demonstrates the potential of deep learning in marine science and provides a significant technical support for global changes and marine ecosystem research.
基金supported in part by Beijing Natural Science Foundation under Grant L251058in part by Project of State Key Lab of Intelligent Transportation System under Grant 2024-A001.
摘要Traffic holographic perception refers to the real-time,high-fidelity,and multi-dimensional sensing of traffic states through the fusion of heterogeneous sensors,including cameras,radars,and connected vehicle data.The multi-source perception data obtained thereby can provide a complete digital representation of the road network for the Intelligent Transportation System(ITS).However,sensors are vulnerable to environmental interference,which can result in data loss at specific points or along arterial highways for certain periods,potentially undermining system safety and decision-making reliability.To address these challenges,a deep learning method based on Graph Convolutional Networks(GCN)and Gated Recurrent Units(GRU)is proposed,leveraging Artificial Intelligence(AI)and intelligent connected technologies for real-time acquisition of multi-sensor perception data.A feature-level fusion integrates multi-source perception data.GCN captures spatial dependencies from the road network topology,while GRU extracts temporal features from time series,enabling accurate imputation of missing traffic data.The method is evaluated at intelligent connected intersections in the Beijing High-level Autonomous Driving Demonstration Area.Results show that the accuracy of long-term traffic state completion reaches 89.36%,and the Root Mean Square Error(RMSE)is reduced by 17.2%compared to the Long Short-Term Memory(LSTM)baseline.This framework provides a practical solution for deploying traffic holographic perception technology in secure and trustworthy ITS.
基金funded by National Social Science Fund of China,grant number 23BYY197.
摘要Image captioning,a pivotal research area at the intersection of image understanding,artificial intelligence,and linguistics,aims to generate natural language descriptions for images.This paper proposes an efficient image captioning model named Mob-IMWTC,which integrates improved wavelet convolution(IMWTC)with an enhanced MobileNet V3 architecture.The enhanced MobileNet V3 integrates a transformer encoder as its encoding module and a transformer decoder as its decoding module.This innovative neural network significantly reduces the memory space required and model training time,while maintaining a high level of accuracy in generating image descriptions.IMWTC facilitates large receptive fields without significantly increasing the number of parameters or computational overhead.The improvedMobileNet V3 model has its classifier removed,and simultaneously,it employs IMWTC layers to replace the original convolutional layers.This makes Mob-IMWTC exceptionally well-suited for deployment on lowresource devices.Experimental results,based on objective evaluation metrics such as BLEU,ROUGE,CIDEr,METEOR,and SPICE,demonstrate that Mob-IMWTC outperforms state-of-the-art models,including three CNN architectures(CNN-LSTM,CNN-Att-LSTM,CNN-Tran),two mainstream methods(LCM-Captioner,ClipCap),and our previous work(Mob-Tran).Subjective evaluations further validate the model’s superiority in terms of grammaticality,adequacy,logic,readability,and humanness.Mob-IMWTC offers a lightweight yet effective solution for image captioning,making it suitable for deployment on resource-constrained devices.
基金The work described in this paper was fully supported by a grant from Hong Kong Metropolitan University(RIF/2021/05).
摘要Parkinson’s disease(PD)is a debilitating neurological disorder affecting over 10 million people worldwide.PD classification models using voice signals as input are common in the literature.It is believed that using deep learning algorithms further enhances performance;nevertheless,it is challenging due to the nature of small-scale and imbalanced PD datasets.This paper proposed a convolutional neural network-based deep support vector machine(CNN-DSVM)to automate the feature extraction process using CNN and extend the conventional SVM to a DSVM for better classification performance in small-scale PD datasets.A customized kernel function reduces the impact of biased classification towards the majority class(healthy candidates in our consideration).An improved generative adversarial network(IGAN)was designed to generate additional training data to enhance the model’s performance.For performance evaluation,the proposed algorithm achieves a sensitivity of 97.6%and a specificity of 97.3%.The performance comparison is evaluated from five perspectives,including comparisons with different data generation algorithms,feature extraction techniques,kernel functions,and existing works.Results reveal the effectiveness of the IGAN algorithm,which improves the sensitivity and specificity by 4.05%–4.72%and 4.96%–5.86%,respectively;and the effectiveness of the CNN-DSVM algorithm,which improves the sensitivity by 1.24%–57.4%and specificity by 1.04%–163%and reduces biased detection towards the majority class.The ablation experiments confirm the effectiveness of individual components.Two future research directions have also been suggested.
基金supported by the Ministry of Education(MOE)Singapore,Academic Research Fund(AcRF)Tier 1(RG65/22)。
摘要Convolutional neural networks(CNNs)have shown remarkable success across numerous tasks such as image classification,yet the theoretical understanding of their convergence remains underdeveloped compared to their empirical achievements.In this paper,the first filter learning framework with convergence-guaranteed learning laws for end-to-end learning of deep CNNs is proposed.Novel update laws with convergence analysis are formulated based on the mathematical representation of each layer in convolutional neural networks.The proposed learning laws enable concurrent updates of weights across all layers of the deep convolutional neural network and the analysis shows that the training errors converge to certain bounds which are dependent on the approximation errors.Case studies are conducted on benchmark datasets and the results show that the proposed concurrent filter learning framework guarantees the convergence and offers more consistent and reliable results during training with a trade-off in performance compared to stochastic gradient descent methods.This framework represents a significant step towards enhancing the reliability and effectiveness of deep convolutional neural network by developing a theoretical analysis which allows practical implementation of the learning laws with automatic tuning of the learning rate to guarantee the convergence during training.
摘要Accurate and quick diagnosis of COVID-19 remains a global challenge,as conventional RT-PCR testing suffers from high false-negative rates,delays,and limited availability.Chest X-ray imaging,while more accessible,requires expert interpretation and is prone to human error.Although several deep learning methods have been applied,many face issues of overfitting,insufficient feature selection,and reduced reliability.In order to overcome these constraints,we suggest a hybrid framework,COVID-19-DSCNN-XISSP,which integrates a Deep Spatial Convolutional Neural Network(DSCNN)for robust spatial excision of features with the Exponential Incremental Social Ski Driver with Sine Cosine Algorithm(XISSP)for optimal feature selection.This strategy enhances classification accuracy while reducing computational overhead.Extensive experiments on benchmark COVID-19 chest X-ray datasets demonstrate that the proposed model outperforms existing approaches in terms of accuracy,precision,and robustness.The findings highlight the potential of COVID-19-DSCNN-XISSP as an economical,automated,and expandable tool for assisting radiologists in early and reliable detection of COVID-19,thereby supporting improved clinical decision-making and pandemic control.
摘要In contemporary computer vision,convolutional neural networks(CNNs)and vision transformers(ViTs)represent the two primary architectural paradigms for image recognition.While both approaches have been widely adopted in medical imaging applications,they operate based on fundamentally different computational principles.This report attempts to provide brief application notes on ViTs and CNNs,particularly focusing on scenarios that guide the selection of one architecture over the other in practical medical implementations.Generally,CNNs rely on convolutional kernels,localized receptive fields,and weight sharing,enabling efficient hierarchical feature extraction.These properties contribute to strong performance in detecting spatially constrained patterns such as textures,edges,and anatomical boundaries,while maintaining relatively low computational requirements.ViTs,on the other hand,decompose images into smaller segments referred to as tokens and employ self-attention mechanisms to model relationships across the entire image.This global modeling capability allows ViTs to capture long-range dependencies that may be difficult for convolution-based architectures to learn.However,ViTs typically achieve optimal performance when trained on extremely large datasets or when supported by extensive pretraining,as their reduced inductive bias requires greater data exposure to learn robust representations.This report briefly examines the architectural structure,underlying mathematical foundations,and relative performance characteristics of CNNs and ViTs,drawing upon recent findings from contemporary research.Emphasis is placed on understanding how differences in data availability,computational resources,and task requirements influence model effectiveness across medical imaging domains.Most importantly,the report serves as a concise application guide for practitioners seeking informed implementation decisions between these two influential deep learning frameworks.
基金supported in part by the National Natural Science Foundation of China(62573387)the Natural Science Foundation of Zhejiang province,China(LY24F030004)the Fundamental Research Funds of Zhejiang Sci-Tech University(25222139-Y).
摘要Partial least squares (PLS) model maximizes the covariance between process variables and quality variables,making it widely used in quality-related fault detection.However,traditional PLS methods focus primarily on linear processes,leading to poor performance in dynamic nonlinear processes.In this paper,a novel quality-related fault detection method,named DiCAE-PLS,is developed by combining dynamic-inner convolutional autoencoder with PLS.In the proposed DiCAE-PLS method,latent features are first extracted through dynamic-inner convolutional autoencoder (DiCAE) to capture process dynamics and nonlinearity from process variables.Then,a PLS model is established to build the relationship between the extracted latent features and the final product quality.To detect quality-related faults,Hotelling's T2 statistic is employed.The developed quality-related fault detection is applied to the widely used industrial benchmark of the Tennessee.
基金funded by scientific research projects under Grant JY2024B011.
摘要With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.
基金Project supported by the CAS project for Young Scientists in Basic Research(Grant Nos.YSBR-059 and YSBR115)the National Natural Science Foundation of China(Grant No.92150103)。
摘要Attosecond light sources serve as crucial tools for investigating the ultrafast electronic dynamics in matter with remarkable temporal resolution.Traditional methods face difficulties in accurately measuring attosecond pulses,and the prevailing approach involves utilizing attosecond streak cameras coupled with inversion algorithms to reconstruct phase information.However,these algorithms often require multiple iterations and extensive computational time.This study investigates the utilization of autocorrelation graphs as inputs for a convolutional neural network(CNN)to invert streaking traces obtained by attosecond streak camera.We explore the noise resistance capability of autocorrelation within the CNN inversion and aim to provide a physical explanation for its effectiveness.The objective of this research is to enhance the accuracy and reliability of CNN inversion for attosecond streaking traces,enabling improved resilience against experimental noises.
基金Support by Sichuan Science and Technology Program[2023YFSY0026,2023YFH0004]Guangzhou Huashang University[2024HSZD01,HS2023JYSZH01].
摘要Graph neural networks(GNN)have shown strong performance in node classification tasks,yet most existing models rely on uniform or shared weight aggregation,lacking flexibility in modeling the varying strength of relationships among nodes.This paper proposes a novel graph coupling convolutional model that introduces an adaptive weighting mechanism to assign distinct importance to neighboring nodes based on their similarity to the central node.Unlike traditional methods,the proposed coupling strategy enhances the interpretability of node interactions while maintaining competitive classification performance.The model operates in the spatial domain,utilizing adjacency list structures for efficient convolution and addressing the limitations of weight sharing through a coupling-based similarity computation.Extensive experiments are conducted on five graph-structured datasets,including Cora,Citeseer,PubMed,Reddit,and BlogCatalog,as well as a custom topology dataset constructed from the Open University Learning Analytics Dataset(OULAD)educational platform.Results demonstrate that the proposed model achieves good classification accuracy,while significantly reducing training time through direct second-order neighbor fusion and data preprocessing.Moreover,analysis of neighborhood order reveals that considering third-order neighbors offers limited accuracy gains but introduces considerable computational overhead,confirming the efficiency of first-and second-order convolution in practical applications.Overall,the proposed graph coupling model offers a lightweight,interpretable,and effective framework for multi-label node classification in complex networks.