Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex ge...Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex geological conditions,limiting their accuracy in challenging environments.To address these challenges,a deep learning model for lithology identificationwhile drilling is proposed.The proposed model introduces a dual attention mechanism in the long short-term memory(LSTM)network,effectively enhancing the ability to capture spatial and channel dimension information.Subsequently,the crayfishoptimization algorithm(COA)is applied to optimize the model network structure,thereby enhancing its lithology identificationcapability.Laboratory test results demonstrate that the proposed model achieves 97.15%accuracy on the testing set,significantlyoutperforming the traditional support vector machine(SVM)method(81.77%).Field tests under actual drilling conditions demonstrate an average accuracy of 91.96%for the proposed model,representing a 14.31%improvement over the LSTM model alone.The proposed model demonstrates robust adaptability and generalization ability across diverse operational scenarios.This research offers reliable technical support for lithology identification while drilling.展开更多
In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in d...In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in dynamic settings.To address this,this paper proposes a node ranking method that combines graph attention mechanisms with contrastive learning.Community detection is employed to extract node-level community features,and a joint embedding module is designed to fuse global and local structures,thereby incorporating community information into node representations.Based on this,a multi-layer graph attention network adaptively learns node and neighborhood features,while contrastive learning mitigates interference from dynamic evolution and strengthens the model's ability to capture multi-scale structural differences.Experiments on multiple dynamic network datasets show that the proposed method significantly outperforms existing approaches in ranking accuracy,particularly in networks with higher average degrees and clearer community structures.These results validate the effectiveness of the method in enhancing feature representation and modeling multi-scale dynamic node influence.展开更多
Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such ...Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such as SwinIR,Restormer,and HAT—have recently achieved impressive results in super-resolution tasks by capturing global contextual information,these methods often suffer from substantial computational and memory overhead,which limits their deployment on resource-constrained edge devices.To address these challenges,we propose a novel lightweight super-resolution network,termed Binary Attention-Guided Information Distillation(BAID),which integrates frequency-aware modeling with a binary attention mechanism to significantly reduce computational complexity and parameter count whilemaintaining strong reconstruction performance.The network combines a high–low frequency decoupling strategy with a local–global attention sharing mechanism,enabling efficient compression of redundant computations through binary attention guidance.At the core of the architecture lies the Attention-Guided Distillation Block(AGDB),which retains the strengths of the information distillation framework while introducing a sparse binary attention module to enhance both inference efficiency and feature representation.Extensive×4 superresolution experiments on four standard benchmarks—Set5,Set14,BSD100,and Urban100—demonstrate that BAID achieves Peak Signal-to-Noise Ratio(PSNR)values of 32.13,28.51,27.47,and 26.15,respectively,with only 1.22 million parameters and 26.1 G Floating-Point Operations(FLOPs),outperforming other state-of-the-art lightweight methods such as Information Multi-Distillation Network(IMDN)and Residual Feature Distillation Network(RFDN).These results highlight the proposed model’s ability to deliver high-quality image reconstruction while offering strong deployment efficiency,making it well-suited for image restoration tasks in resource-limited environments.展开更多
Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts ...Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts of samples,and vague feature extraction.To address these problems,this paper proposes an enhanced intelligent recognition model based on an improved residual network.Taking remote sensing images from landslide-prone areas in Bijie City,Guizhou Province,China as the research subject,we implemented data augmentation techniques to expand the datasets,subsequently partitioning it into training and validation subsets at a73:27 ratio.During model training,a transfer learning strategy was employed to improve training efficiency through the utilization of ImageNet pre-trained weights.The Res Net50 network architecture was enhanced through the integration of channel attention and spatial attention mechanisms,enabling more effective extraction of critical landslide features.Comparative analysis indicates that after introducing the attention mechanisms,the enhanced model achieved an increase of 1.49% in accuracy,0.45% in precision,1.52% in F1 score,and 0.0297 in Kappa coefficient on the validation set.Notably,recall improved by 2.59%,indicating that the improved model has enhanced landslide disaster recognition capability and overall performance.This study successfully coupled the transfer learning strategy with a dual-attention mechanism into the ResNet50 architecture,allowing the rapid construction of an efficient recognition model under limited sample conditions,significantly improving the comprehensive performance and generalisation ability of the landslide recognition model.展开更多
To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em...To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em-bedded long short-term memory(ATT-LSTM)deep learning model for sea fog visibility hazard prediction.This archi-tecture seamlessly incorporates ATT into the conventional LSTM neural network framework.This integration enables the model to adaptively assign weights to the input features,thereby distinguishing between salient and non-salient variables.This targeted allocation enhances the contribution of considerable factors within the LSTM forecasting algorithm,opti-mizes input data,and assigns varying levels of attention to each variable.Consequently,the model substantially mitigates prediction errors in multivariate scenarios.An empirical analysis employing an independent dataset encompassing 303 foggy days over a biennial period confirmed the superior performance of the proposed ATT-LSTM model.Comparative evaluations with LSTM,logistic classification regression,and support vector machine classification regression models revealed that the ATT-LSTM model achieved a recall rate of 37%,a precision rate of 48%,an accuracy rate of 91%,and a threat score(TS)of 0.26.Among the assessed methodologies,the ATT-LSTM model outperformed the others in terms of recall,accuracy,and TS metrics.These findings confirm that the ATT-LSTM model offers a potent and innovative deep learning approach for enhancing the accuracy of low-visibility sea fog hazard predictions.展开更多
Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model Y...Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model YOLO-VSF over the YOLOv4 model,which is a representative work with excellent performance among YOLO series of object detection models.The main improvement measures include:The backbone feature extraction network CSPDarknet53 of YOLOv4 is replaced with VGG16 to improve the feature extraction capability;SENet attention mechanism is incorporated to improve the salient and correlation feature representation capability;Focal Loss is integrated into the loss function to overcome the sample imbalance problem.In addition,the detection performance of small targets is improved by increasing the resolution of input images.Experimental results show that on the VanJee traffic image dataset provided by Beijing VanJee Technology Co.,Ltd.,the proposed YOLO-VSF model achieves an average mean accuracy(mAP)of 92.21 percentage points,which improves the mAP by 3.04 percentage points compared with the YOLOv4 model while maintaining the detection speed of the original model.On the UA-DETRAC dataset,the average accuracy of YOLO-VSF is close to that of the latest YOLOv7 model with the number of parameters reduced by 1.329×107.The proposed method can provide a support for object detection in traffic scenes.展开更多
In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it...In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it to the base station(BS).As the number of antennas increases,there is a significant rise in the overhead related to CSI feedback,posing considerable challenges to the precise acquisition of CSI by the BS.Existing approaches to CSI feedback utilizing deep learning techniques face challenges such as significant feedback overhead and limited precision in the reconstruction process.This study presents a novel lightweight CSI feedback framework known as the dual attention neural network(DANet).Within the DANet architecture,a dual attention module(DAM)is designed to enhance the network's performance.This DAM includes both channel attention blocks and spatial attention blocks.The channel attention blocks direct the model's focus toward channel features rich in information content while simultaneously suppressing less significant features.This approach enables the extraction of temporal correlations within the CSI matrix.The spatial attention block aids in extracting the correlation between the delay domain and the angle domain in the CSI matrix.By enhancing neural network performance,the DAM reduces information dispersion while enhancing the representation of global interactions.Simulation results demonstrate that DANet exhibits superior normalized mean square error and cosine similarity with comparable complexity compared to existing advanced CSI feedback methods.展开更多
Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-te...Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-temporal attention network model(DSAN)is proposed.The model is constructed by fusing temporal convolutional networks(TCN),long short-term memory networks(LSTM),and multi-head attention mechanisms to form parallel feature extraction branches for hierarchical spatio-temporal modeling.Validation is conducted based on full-scale pavement loop test results of eight typical asphalt pavement structures(AC layer thickness:12–52 cm)under 80 million equivalent standard axle loads(ESALs)accumulated during 2017–2023.Results show that the DSAN model significantly outperforms comparative models in prediction accuracy,breaking through the generalization bottleneck of traditional models for different layer thickness structures.This study provides an efficient solution for long-term performance prediction of asphalt pavements.展开更多
Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contempo...Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contemporary enterprises typically operate 200+interconnected systems,with research indicating that 52% of organizations manage three or more enterprise content management systems,creating information silos that reduce operational efficiency by up to 35%.While attention mechanisms have demonstrated remarkable success in natural language processing and computer vision,their systematic application to business information systems remains largely unexplored.This paper presents the theoretical foundation for a Hierarchical Attention-Based Business Information System(HABIS)framework that applies multi-level attention mechanisms to enterprise environments.We provide a comprehensive mathematical formulation of the framework,analyze its computational complexity,and present a proof-of-concept implementation with simulation-based validation that demonstrates a 42% reduction in crosssystem query latency compared to legacy ERP modules and 70% improvement in prediction accuracy over baseline methods.The theoretical framework introduces four hierarchical attention levels:system-level attention for dynamic weighting of business systems,process-level attention for business process prioritization,data-level attention for critical information selection,and temporal attention for time-sensitive pattern recognition.Our complexity analysis demonstrates that the framework achieves O(n log n)computational complexity for attention computation,making it scalable to large enterprise environments including retail supply chains with 200+system-scale deployments.The proof-of-concept implementation validates the theoretical framework’s feasibility withMSE loss of 0.439 and response times of 0.000120 s per query,demonstrating its potential for addressing key challenges in business information systems.This work establishes a foundation for future empirical research and practical implementation of attention-driven enterprise systems.展开更多
The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly fa...The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly faces two challenges:one is the loss of information and interference caused by occlusion and stacking in the sorting scenario,the other is the difficulty of feature extraction due to the weak texture of industrial parts.To address the above problems,this paper proposes an attention-based pixel-level voting network for 6D pose estimation of weakly textured industrial parts,namely CB-PVNet.On the one hand,the voting scheme can predict the keypoints of affected pixels,which improves the accuracy of keypoint localization even in scenarios such as weak texture and partial occlusion.On the other hand,the attention mechanism can extract interesting features of the object while suppressing useless features of surroundings.Extensive comparative experiments were conducted on both public datasets(including LINEMOD,Occlusion LINEMOD and T-LESS datasets)and self-made datasets.The experimental results indicate that the proposed network CB-PVNet can achieve accuracy of ADD(-s)comparable to state-of-the-art using only RGB images while ensuring real-time performance.Additionally,we also conducted robot grasping experiments in the real world.The balance between accuracy and computational efficiency makes the method well-suited for applications in industrial automation.展开更多
This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.Th...This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.The proposed model is based on the large version of MobileNetV3 and adds more spatial attention blocks and an embedding-based head that was trained using margin-based triplet learning,enabling fine-grained modeling of iris textures in a compact representation.To further improve discriminability,we design a training pipeline that combines dynamic-margin triplet loss,a staged hard/semi-hard negative mining strategy,and feature-level knowledge distillation from a ResNet-50 teacher.Finally,we investigate the use of post-training float16 quantization to reduce memory footprint and latency for deployment on mobile hardware.Experiments on the challenging CASIA-IrisV4-Thousand dataset show that the full-precision MobiIris model requires only 12 MB of storage and 27 ms inference latency,while achieving an EER of 1.409%,VR@FAR=1%of 98.184%,and CMC@1 of 94.785%,closely matching a ResNet-50 baseline that is more than 7×larger and slower.Under post-training quantization,the model shrinks to 5.94 MB with 13 ms latency and maintains a competitive balance between accuracy and efficiency compared to other optimized variants.These results demonstrate that a coherent combination of lightweight architecture design,attention mechanisms,metric-learning objectives,hard negative mining,and knowledge distillation yields a practical iris recognition solution suitable for secure,real-time authentication on mobile and embedded platforms.展开更多
Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling...Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling relationships among chemical entities.This study proposes a multi-scale temporal feature extraction module to extract local dynamic temporal features across different time scales and combines it with long short-term memory(LSTM)networks to capture global temporal patterns,thereby taking full advantage of available data.In addition,variable-wise channel attention is integrated into the model to enhance attention on the essential parts of the feature maps and improve predictive performance.Furthermore,by analyzing the attention weights,the model quickly identifies the key variables that significantly affect the predictions.Finally,the model is applied to a real corn starch liquefaction process and achieves an accurate product quality prediction with an R2 value of 0.9392,which represents a 4%to 9%improvement over traditional models and demonstrates the superiority of the proposed approach.展开更多
Background Preclinical studies have shown that volatile anaesthetics,particularly sevoflurane,can disrupt neurodevelopment by inducing neuronal apoptosis,neuroinflammation and altered synaptic plasticity during critic...Background Preclinical studies have shown that volatile anaesthetics,particularly sevoflurane,can disrupt neurodevelopment by inducing neuronal apoptosis,neuroinflammation and altered synaptic plasticity during critical periods of brain maturation.Whether these mechanisms translate into long-term neurobehavioral risk in children remains uncertain.Aims To compare the long-term risk of attention-deficit/hyperactivity disorder(ADHD)following paediatric anaesthesia with sevoflurane versus propofol in a large,multinational real-world cohort.Methods We conducted a large,multinational,retrospective cohort study using real-world electronic health record data from more than 150 healthcare organisations across North America,Europe and Asia.Children and adolescents(0-18 years)who underwent a single surgical procedure under general anaesthesia between 2005 and 2025 were included.Patients with ADHD or multiple anaesthetic exposures were excluded.The primary exposure was sevoflurane versus propofol as the main anaesthetic.The primary outcome was newonset ADHD identified by International Classification of Diseases,Ninth or Tenth Revision codes after surgery.Propensity-score matching(1:1),subgroup,sensitivity and positiveegative control analyses were performed to ensure robustness.Results Among 54102 matched children(27051 per group),the cumulative incidence of ADHD was 5.63%after sevoflurane and 2.95%after propofol,corresponding to incidence rates of 134.9 and 105.4 per 10000 person-years.Sevoflurane exposure was associated with a higher risk of ADHD(hazard ratio 1.21;95%confidence interval 1.11-1.31;p<0.001).Findings were consistent across subgroups and sensitivity analyses;mortality was rare and similar between groups.Conclusions In this multinational cohort,sevoflurane exposure during paediatric anaesthesia was associated with an increased long-term risk of ADHD compared with propofol.These findings suggest that anaesthetic choice may have enduring neurobehavioral consequences and that prospective validation is warranted to guide safer paediatric anaesthesia practice.展开更多
Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning...Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning to mitigate accuracy degradation in 24-h forecasting.Initially,an optimized DB-SCAN(Density-Based Spatial Clustering of Applications with Noise)algorithm clusters wind fields based on wind direction,probability density,and spectral features,enhancing physical interpretability and reducing training complexity.Subsequently,a ResNet(Residual Network)extracts multi-scale patterns from decomposed wind signals,while transfer learning adapts the backbone network across clusters,cutting training time by over 90%.Finally,a CBAM(Convolutional Block Attention Module)attention mechanism is employed to prioritize features for LSTM-based prediction.Tested on the 2015 Jena wind speed dataset,the model demonstrates superior accuracy and robustness compared to state-of-the-art baselines.Key innovations include:(a)Physics-informed clustering for interpretable wind regime classification;(b)Transfer learning with deep feature extraction,preserving accuracy while minimizing training time;and(c)On the 2016 Jena wind speed dataset,the model achieves MAPE(Mean Absolute Percentage Error)values of 16.82%and 18.02%for the Weibull-shaped and Gaussian-shaped wind speed clusters,respectively,demonstrating the model’s robust generalization capacity.This framework offers an efficient and effective solution for long-term wind forecasting.展开更多
Few-shot knowledge graph completion refers to inferring missing entity using limited instances.A key challenge lies in entity representation,which is complicated by diverse neighbor attributes.Although the entity'...Few-shot knowledge graph completion refers to inferring missing entity using limited instances.A key challenge lies in entity representation,which is complicated by diverse neighbor attributes.Although the entity's neighborhood topology holds potential to address this,its significance is overlooked in current research.In this paper,we propose a structure-aware graph attention network for few-shot knowledge graph completion.Firstly,to enhance entity representations,we design a structure-aware graph attention encoder to capture the graph's structural features of nodes,generating embedding for entity pairs.Secondly,a semantic prototype matching network is employed to compute the prediction score.Experiments on the NELL-One and Wiki-One datasets show that our proposed model outperforms the best baseline models by 0.021,0.026,0.039,0.032 and 0.016,0.064,0.043,0.040 in terms of MRR,Hits@10,Hits@5,and Hits@1 metrics,respectively.This demonstrates that our model can effectively leverage neighborhood topological information to improve the accuracy of knowledge completion,and achieve a better generalization.展开更多
基金supported by the National Key Research and Development Program for Young Scientists,Chin(Grant No.2021YFC2900400)the Sichuan-Chongqing Science and Technology Innovation Cooperation Program Project,China(Grant No.2024TIAD-CYKJCXX0269)the National Natural Science Foundation of China,China(Grant No.52304123).
摘要Lithology identificationwhile drilling technology can obtain rock information in real-time.However,traditional lithology identificationmodels often face limitations in feature extraction and adaptability to complex geological conditions,limiting their accuracy in challenging environments.To address these challenges,a deep learning model for lithology identificationwhile drilling is proposed.The proposed model introduces a dual attention mechanism in the long short-term memory(LSTM)network,effectively enhancing the ability to capture spatial and channel dimension information.Subsequently,the crayfishoptimization algorithm(COA)is applied to optimize the model network structure,thereby enhancing its lithology identificationcapability.Laboratory test results demonstrate that the proposed model achieves 97.15%accuracy on the testing set,significantlyoutperforming the traditional support vector machine(SVM)method(81.77%).Field tests under actual drilling conditions demonstrate an average accuracy of 91.96%for the proposed model,representing a 14.31%improvement over the LSTM model alone.The proposed model demonstrates robust adaptability and generalization ability across diverse operational scenarios.This research offers reliable technical support for lithology identification while drilling.
摘要In complex network analysis,node ranking is vital for propagation prediction,structural optimization,and intervention strategy design,yet existing methods often fail to effectively integrate community information in dynamic settings.To address this,this paper proposes a node ranking method that combines graph attention mechanisms with contrastive learning.Community detection is employed to extract node-level community features,and a joint embedding module is designed to fuse global and local structures,thereby incorporating community information into node representations.Based on this,a multi-layer graph attention network adaptively learns node and neighborhood features,while contrastive learning mitigates interference from dynamic evolution and strengthens the model's ability to capture multi-scale structural differences.Experiments on multiple dynamic network datasets show that the proposed method significantly outperforms existing approaches in ranking accuracy,particularly in networks with higher average degrees and clearer community structures.These results validate the effectiveness of the method in enhancing feature representation and modeling multi-scale dynamic node influence.
基金funded by Project of Sichuan Provincial Department of Science and Technology under 2025JDKP0150the Fundamental Research Funds for the Central Universities under 25CAFUC03093.
摘要Single Image Super-Resolution(SISR)seeks to reconstruct high-resolution(HR)images from lowresolution(LR)inputs,thereby enhancing visual fidelity and the perception of fine details.While Transformer-based models—such as SwinIR,Restormer,and HAT—have recently achieved impressive results in super-resolution tasks by capturing global contextual information,these methods often suffer from substantial computational and memory overhead,which limits their deployment on resource-constrained edge devices.To address these challenges,we propose a novel lightweight super-resolution network,termed Binary Attention-Guided Information Distillation(BAID),which integrates frequency-aware modeling with a binary attention mechanism to significantly reduce computational complexity and parameter count whilemaintaining strong reconstruction performance.The network combines a high–low frequency decoupling strategy with a local–global attention sharing mechanism,enabling efficient compression of redundant computations through binary attention guidance.At the core of the architecture lies the Attention-Guided Distillation Block(AGDB),which retains the strengths of the information distillation framework while introducing a sparse binary attention module to enhance both inference efficiency and feature representation.Extensive×4 superresolution experiments on four standard benchmarks—Set5,Set14,BSD100,and Urban100—demonstrate that BAID achieves Peak Signal-to-Noise Ratio(PSNR)values of 32.13,28.51,27.47,and 26.15,respectively,with only 1.22 million parameters and 26.1 G Floating-Point Operations(FLOPs),outperforming other state-of-the-art lightweight methods such as Information Multi-Distillation Network(IMDN)and Residual Feature Distillation Network(RFDN).These results highlight the proposed model’s ability to deliver high-quality image reconstruction while offering strong deployment efficiency,making it well-suited for image restoration tasks in resource-limited environments.
基金supported by the National Natural Science Foundation of China[NSFC,Grant Nos.U22A20597,42507217]the"Unveiling and Commanding"Project of Science and Technology Program of Tibet[Grant No.XZ202303ZY0006G]the"Key Research and Development Program"Project of Science and Technology Program of Tibet[Grant Nos.XZ202501ZY0104,XZ202501ZY0132]。
摘要Landslides are one of the most significant types of geological disasters worldwide.However,current landslide disaster recognition models generally face issues such as low training efficiency,reliance on large amounts of samples,and vague feature extraction.To address these problems,this paper proposes an enhanced intelligent recognition model based on an improved residual network.Taking remote sensing images from landslide-prone areas in Bijie City,Guizhou Province,China as the research subject,we implemented data augmentation techniques to expand the datasets,subsequently partitioning it into training and validation subsets at a73:27 ratio.During model training,a transfer learning strategy was employed to improve training efficiency through the utilization of ImageNet pre-trained weights.The Res Net50 network architecture was enhanced through the integration of channel attention and spatial attention mechanisms,enabling more effective extraction of critical landslide features.Comparative analysis indicates that after introducing the attention mechanisms,the enhanced model achieved an increase of 1.49% in accuracy,0.45% in precision,1.52% in F1 score,and 0.0297 in Kappa coefficient on the validation set.Notably,recall improved by 2.59%,indicating that the improved model has enhanced landslide disaster recognition capability and overall performance.This study successfully coupled the transfer learning strategy with a dual-attention mechanism into the ResNet50 architecture,allowing the rapid construction of an efficient recognition model under limited sample conditions,significantly improving the comprehensive performance and generalisation ability of the landslide recognition model.
基金Guangxi Key Research and Development Program(Guike AB20159013)National Natural Science Foundation of China(4206050052)China Meteorological Administration Innovation Development Project(CXFZ2022J029)。
摘要To address the complexities associated with forecasting low-probability,low-visibility fog events and the underlying nonlinear interdependencies among various influencing variables,we present an attention mechanism-em-bedded long short-term memory(ATT-LSTM)deep learning model for sea fog visibility hazard prediction.This archi-tecture seamlessly incorporates ATT into the conventional LSTM neural network framework.This integration enables the model to adaptively assign weights to the input features,thereby distinguishing between salient and non-salient variables.This targeted allocation enhances the contribution of considerable factors within the LSTM forecasting algorithm,opti-mizes input data,and assigns varying levels of attention to each variable.Consequently,the model substantially mitigates prediction errors in multivariate scenarios.An empirical analysis employing an independent dataset encompassing 303 foggy days over a biennial period confirmed the superior performance of the proposed ATT-LSTM model.Comparative evaluations with LSTM,logistic classification regression,and support vector machine classification regression models revealed that the ATT-LSTM model achieved a recall rate of 37%,a precision rate of 48%,an accuracy rate of 91%,and a threat score(TS)of 0.26.Among the assessed methodologies,the ATT-LSTM model outperformed the others in terms of recall,accuracy,and TS metrics.These findings confirm that the ATT-LSTM model offers a potent and innovative deep learning approach for enhancing the accuracy of low-visibility sea fog hazard predictions.
基金the National Natural Science Foundation of China(No.62271466)the Beijing Natural Science Foundation(No.4202025)+2 种基金the Beijing VanJee Technology Co.,Ltd.-Beijing Municipal Science and Technology Project(No.Z201100003920003)the Tianjin IoT Technology Enterprise Key Laboratory Research Project(No.VTJ-OT20230209-2)the Guizhou Provincial Sci-Tech Project(No.zk[2022]-012)。
摘要Intelligent transportation and autonomous driving systems have made urgent demands on the techniques with high performance on object detection in traffic scenes.This paper proposes an improved object detection model YOLO-VSF over the YOLOv4 model,which is a representative work with excellent performance among YOLO series of object detection models.The main improvement measures include:The backbone feature extraction network CSPDarknet53 of YOLOv4 is replaced with VGG16 to improve the feature extraction capability;SENet attention mechanism is incorporated to improve the salient and correlation feature representation capability;Focal Loss is integrated into the loss function to overcome the sample imbalance problem.In addition,the detection performance of small targets is improved by increasing the resolution of input images.Experimental results show that on the VanJee traffic image dataset provided by Beijing VanJee Technology Co.,Ltd.,the proposed YOLO-VSF model achieves an average mean accuracy(mAP)of 92.21 percentage points,which improves the mAP by 3.04 percentage points compared with the YOLOv4 model while maintaining the detection speed of the original model.On the UA-DETRAC dataset,the average accuracy of YOLO-VSF is close to that of the latest YOLOv7 model with the number of parameters reduced by 1.329×107.The proposed method can provide a support for object detection in traffic scenes.
基金National Natural Science Foundation of China(12005108)。
摘要In massive multiple-input multiple-output(MIMO)systems utilizing frequency division duplexing,optimizing system performance requires user equipment(UE)to compress downlink channel state information(CSI)and transmit it to the base station(BS).As the number of antennas increases,there is a significant rise in the overhead related to CSI feedback,posing considerable challenges to the precise acquisition of CSI by the BS.Existing approaches to CSI feedback utilizing deep learning techniques face challenges such as significant feedback overhead and limited precision in the reconstruction process.This study presents a novel lightweight CSI feedback framework known as the dual attention neural network(DANet).Within the DANet architecture,a dual attention module(DAM)is designed to enhance the network's performance.This DAM includes both channel attention blocks and spatial attention blocks.The channel attention blocks direct the model's focus toward channel features rich in information content while simultaneously suppressing less significant features.This approach enables the extraction of temporal correlations within the CSI matrix.The spatial attention block aids in extracting the correlation between the delay domain and the angle domain in the CSI matrix.By enhancing neural network performance,the DAM reduces information dispersion while enhancing the representation of global interactions.Simulation results demonstrate that DANet exhibits superior normalized mean square error and cosine similarity with comparable complexity compared to existing advanced CSI feedback methods.
基金supported by the Key Research and Development Plan of Shaanxi Province(Grant No.2022JBGS3-08)the Fundamental Research Funds for the Central Universities,CHD(Grant No.300102404102).
摘要Existing asphalt pavement rutting prediction models suffer from large long-term prediction errors due to their reliance on laboratory parameters and simplified assumptions.To address this issue,a dual-branch spatio-temporal attention network model(DSAN)is proposed.The model is constructed by fusing temporal convolutional networks(TCN),long short-term memory networks(LSTM),and multi-head attention mechanisms to form parallel feature extraction branches for hierarchical spatio-temporal modeling.Validation is conducted based on full-scale pavement loop test results of eight typical asphalt pavement structures(AC layer thickness:12–52 cm)under 80 million equivalent standard axle loads(ESALs)accumulated during 2017–2023.Results show that the DSAN model significantly outperforms comparative models in prediction accuracy,breaking through the generalization bottleneck of traditional models for different layer thickness structures.This study provides an efficient solution for long-term performance prediction of asphalt pavements.
摘要Modern business information systems face significant challenges in managing heterogeneous data sources,integrating disparate systems,and providing real-time decision support in complex enterprise environments.Contemporary enterprises typically operate 200+interconnected systems,with research indicating that 52% of organizations manage three or more enterprise content management systems,creating information silos that reduce operational efficiency by up to 35%.While attention mechanisms have demonstrated remarkable success in natural language processing and computer vision,their systematic application to business information systems remains largely unexplored.This paper presents the theoretical foundation for a Hierarchical Attention-Based Business Information System(HABIS)framework that applies multi-level attention mechanisms to enterprise environments.We provide a comprehensive mathematical formulation of the framework,analyze its computational complexity,and present a proof-of-concept implementation with simulation-based validation that demonstrates a 42% reduction in crosssystem query latency compared to legacy ERP modules and 70% improvement in prediction accuracy over baseline methods.The theoretical framework introduces four hierarchical attention levels:system-level attention for dynamic weighting of business systems,process-level attention for business process prioritization,data-level attention for critical information selection,and temporal attention for time-sensitive pattern recognition.Our complexity analysis demonstrates that the framework achieves O(n log n)computational complexity for attention computation,making it scalable to large enterprise environments including retail supply chains with 200+system-scale deployments.The proof-of-concept implementation validates the theoretical framework’s feasibility withMSE loss of 0.439 and response times of 0.000120 s per query,demonstrating its potential for addressing key challenges in business information systems.This work establishes a foundation for future empirical research and practical implementation of attention-driven enterprise systems.
基金supported by the Knowledge Innovation Program of Wuhan-Shuguang Project(Grant No.2023010201020443)the School-Level Scientific Research Project Funding Program of Jianghan University(Grant No.2022XKZX33)the Natural Science Foundation of Hubei Province(Grant No.2024AFB466).
摘要The 6D pose estimation of objects is of great significance for the intelligent assembly and sorting of industrial parts.In the industrial robot production scenarios,the 6D pose estimation of industrial parts mainly faces two challenges:one is the loss of information and interference caused by occlusion and stacking in the sorting scenario,the other is the difficulty of feature extraction due to the weak texture of industrial parts.To address the above problems,this paper proposes an attention-based pixel-level voting network for 6D pose estimation of weakly textured industrial parts,namely CB-PVNet.On the one hand,the voting scheme can predict the keypoints of affected pixels,which improves the accuracy of keypoint localization even in scenarios such as weak texture and partial occlusion.On the other hand,the attention mechanism can extract interesting features of the object while suppressing useless features of surroundings.Extensive comparative experiments were conducted on both public datasets(including LINEMOD,Occlusion LINEMOD and T-LESS datasets)and self-made datasets.The experimental results indicate that the proposed network CB-PVNet can achieve accuracy of ADD(-s)comparable to state-of-the-art using only RGB images while ensuring real-time performance.Additionally,we also conducted robot grasping experiments in the real world.The balance between accuracy and computational efficiency makes the method well-suited for applications in industrial automation.
摘要This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.The proposed model is based on the large version of MobileNetV3 and adds more spatial attention blocks and an embedding-based head that was trained using margin-based triplet learning,enabling fine-grained modeling of iris textures in a compact representation.To further improve discriminability,we design a training pipeline that combines dynamic-margin triplet loss,a staged hard/semi-hard negative mining strategy,and feature-level knowledge distillation from a ResNet-50 teacher.Finally,we investigate the use of post-training float16 quantization to reduce memory footprint and latency for deployment on mobile hardware.Experiments on the challenging CASIA-IrisV4-Thousand dataset show that the full-precision MobiIris model requires only 12 MB of storage and 27 ms inference latency,while achieving an EER of 1.409%,VR@FAR=1%of 98.184%,and CMC@1 of 94.785%,closely matching a ResNet-50 baseline that is more than 7×larger and slower.Under post-training quantization,the model shrinks to 5.94 MB with 13 ms latency and maintains a competitive balance between accuracy and efficiency compared to other optimized variants.These results demonstrate that a coherent combination of lightweight architecture design,attention mechanisms,metric-learning objectives,hard negative mining,and knowledge distillation yields a practical iris recognition solution suitable for secure,real-time authentication on mobile and embedded platforms.
基金the financial support provided by the Special Foundation for State Major Basic Research Program of China(2021YFD2101005)National Natural Science Foundation of China(22478057,22178045).
摘要Data-driven deep learning modeling has been increasingly applied to quality prediction in complex chemical processes.However,the data show complex temporal features due to different residence times and strong coupling relationships among chemical entities.This study proposes a multi-scale temporal feature extraction module to extract local dynamic temporal features across different time scales and combines it with long short-term memory(LSTM)networks to capture global temporal patterns,thereby taking full advantage of available data.In addition,variable-wise channel attention is integrated into the model to enhance attention on the essential parts of the feature maps and improve predictive performance.Furthermore,by analyzing the attention weights,the model quickly identifies the key variables that significantly affect the predictions.Finally,the model is applied to a real corn starch liquefaction process and achieves an accurate product quality prediction with an R2 value of 0.9392,which represents a 4%to 9%improvement over traditional models and demonstrates the superiority of the proposed approach.
基金supported by the National Key Research and Development Programme of China(Funding Number:2023YFC25069003)which funded Zhang's researchby the Lo-Hsu Medical Foundation,Lotung Poh-Ai Hospital,which supported the work of Szu-Yuan Wu(Funding Numbers:11403 and 11404)。
摘要Background Preclinical studies have shown that volatile anaesthetics,particularly sevoflurane,can disrupt neurodevelopment by inducing neuronal apoptosis,neuroinflammation and altered synaptic plasticity during critical periods of brain maturation.Whether these mechanisms translate into long-term neurobehavioral risk in children remains uncertain.Aims To compare the long-term risk of attention-deficit/hyperactivity disorder(ADHD)following paediatric anaesthesia with sevoflurane versus propofol in a large,multinational real-world cohort.Methods We conducted a large,multinational,retrospective cohort study using real-world electronic health record data from more than 150 healthcare organisations across North America,Europe and Asia.Children and adolescents(0-18 years)who underwent a single surgical procedure under general anaesthesia between 2005 and 2025 were included.Patients with ADHD or multiple anaesthetic exposures were excluded.The primary exposure was sevoflurane versus propofol as the main anaesthetic.The primary outcome was newonset ADHD identified by International Classification of Diseases,Ninth or Tenth Revision codes after surgery.Propensity-score matching(1:1),subgroup,sensitivity and positiveegative control analyses were performed to ensure robustness.Results Among 54102 matched children(27051 per group),the cumulative incidence of ADHD was 5.63%after sevoflurane and 2.95%after propofol,corresponding to incidence rates of 134.9 and 105.4 per 10000 person-years.Sevoflurane exposure was associated with a higher risk of ADHD(hazard ratio 1.21;95%confidence interval 1.11-1.31;p<0.001).Findings were consistent across subgroups and sensitivity analyses;mortality was rare and similar between groups.Conclusions In this multinational cohort,sevoflurane exposure during paediatric anaesthesia was associated with an increased long-term risk of ADHD compared with propofol.These findings suggest that anaesthetic choice may have enduring neurobehavioral consequences and that prospective validation is warranted to guide safer paediatric anaesthesia practice.
基金funded by Science and Technology Research and Development Program Project of China Railway Group Limited(No.2023-Major-02)National Natural Science Foundation of China(Grant No.52378200)Sichuan Science and Technology Program(Grant No.2024NSFSC0017).
摘要Accurate wind speed prediction is crucial for stabilizing power grids with high wind energy penetration.This study presents a novel machine learning model that integrates clustering,deep learning,and transfer learning to mitigate accuracy degradation in 24-h forecasting.Initially,an optimized DB-SCAN(Density-Based Spatial Clustering of Applications with Noise)algorithm clusters wind fields based on wind direction,probability density,and spectral features,enhancing physical interpretability and reducing training complexity.Subsequently,a ResNet(Residual Network)extracts multi-scale patterns from decomposed wind signals,while transfer learning adapts the backbone network across clusters,cutting training time by over 90%.Finally,a CBAM(Convolutional Block Attention Module)attention mechanism is employed to prioritize features for LSTM-based prediction.Tested on the 2015 Jena wind speed dataset,the model demonstrates superior accuracy and robustness compared to state-of-the-art baselines.Key innovations include:(a)Physics-informed clustering for interpretable wind regime classification;(b)Transfer learning with deep feature extraction,preserving accuracy while minimizing training time;and(c)On the 2016 Jena wind speed dataset,the model achieves MAPE(Mean Absolute Percentage Error)values of 16.82%and 18.02%for the Weibull-shaped and Gaussian-shaped wind speed clusters,respectively,demonstrating the model’s robust generalization capacity.This framework offers an efficient and effective solution for long-term wind forecasting.
基金the Media Convergence Project of Yunnan Provincial Key Laboratory(No.220235205)。
摘要Few-shot knowledge graph completion refers to inferring missing entity using limited instances.A key challenge lies in entity representation,which is complicated by diverse neighbor attributes.Although the entity's neighborhood topology holds potential to address this,its significance is overlooked in current research.In this paper,we propose a structure-aware graph attention network for few-shot knowledge graph completion.Firstly,to enhance entity representations,we design a structure-aware graph attention encoder to capture the graph's structural features of nodes,generating embedding for entity pairs.Secondly,a semantic prototype matching network is employed to compute the prediction score.Experiments on the NELL-One and Wiki-One datasets show that our proposed model outperforms the best baseline models by 0.021,0.026,0.039,0.032 and 0.016,0.064,0.043,0.040 in terms of MRR,Hits@10,Hits@5,and Hits@1 metrics,respectively.This demonstrates that our model can effectively leverage neighborhood topological information to improve the accuracy of knowledge completion,and achieve a better generalization.