This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.Th...This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.The proposed model is based on the large version of MobileNetV3 and adds more spatial attention blocks and an embedding-based head that was trained using margin-based triplet learning,enabling fine-grained modeling of iris textures in a compact representation.To further improve discriminability,we design a training pipeline that combines dynamic-margin triplet loss,a staged hard/semi-hard negative mining strategy,and feature-level knowledge distillation from a ResNet-50 teacher.Finally,we investigate the use of post-training float16 quantization to reduce memory footprint and latency for deployment on mobile hardware.Experiments on the challenging CASIA-IrisV4-Thousand dataset show that the full-precision MobiIris model requires only 12 MB of storage and 27 ms inference latency,while achieving an EER of 1.409%,VR@FAR=1%of 98.184%,and CMC@1 of 94.785%,closely matching a ResNet-50 baseline that is more than 7×larger and slower.Under post-training quantization,the model shrinks to 5.94 MB with 13 ms latency and maintains a competitive balance between accuracy and efficiency compared to other optimized variants.These results demonstrate that a coherent combination of lightweight architecture design,attention mechanisms,metric-learning objectives,hard negative mining,and knowledge distillation yields a practical iris recognition solution suitable for secure,real-time authentication on mobile and embedded platforms.展开更多
We present the geodesic nature and quantization of geometric shift vector in quantum systems,with the parameter space defined by the Bloch momentum,using the Wilson loop approach.Our analysis extends to include bosoni...We present the geodesic nature and quantization of geometric shift vector in quantum systems,with the parameter space defined by the Bloch momentum,using the Wilson loop approach.Our analysis extends to include bosonic phonon drag shift vectors with non-vertical transitions.We demonstrate that the gauge invariant shift vector can be quantized as integer values,analogous to the Euler characteristic based on the Gauss-Bonnet theorem for a manifold with a smooth boundary.We reveal intricate relationships among geometric quantities such as the shift vector,Berry curvature,and quantum metric.Our findings demonstrate that the loop integral of the shift vector in the quantized interband formula contributes to the non-quantized component of the trace of conductivity in the circular photogalvanic effect.The Wilson loop method facilitates first-principles calculations,providing insights in the geometric underpinnings of these interband gauge invariant quantities and shedding light on their nonlinear optical manifestations in real materials.展开更多
We introduce the DARE-Q(Distribution-Aware Residual Entropy Quantization)method—a post-training quantization method for neural network weights designed to reduce bit-width with minimal degradation of model quality.Un...We introduce the DARE-Q(Distribution-Aware Residual Entropy Quantization)method—a post-training quantization method for neural network weights designed to reduce bit-width with minimal degradation of model quality.Unlike traditional approaches that solely optimize the mean squared error of weight approximation,DARE-Q additionally considers the entropy of the quantization residual,allowing for control over the statistical properties of the resulting error.The method is based on channel-wise symmetric uniform quantization with scaling based on a combined loss function that includes L2 distortion and entropy regularization.The DARE-Q method is implemented as a compact DAREQuantLinear module which can be easily integrated into standard transformer pipelines without changing the inference logic or using specific kernels.The experimental analysis was conducted on the language models facebook/opt-125m and facebook/opt-350m,which contain approximately 125 and 350 million parameters.The quality of the models was assessed using the standard perplexity metric(PPL)computed on the wikitext-2-raw-v1 dataset.DARE-Q is completely data-free and does not require model retraining or calibration data,which makes it the only viable option in privacy-sensitive or confidential environments where access to the original training data is restricted—precisely the setting where methods such as GPTQ and AWQ cannot be applied.The observed increase in PPL relative to data-dependent baselines reflects this fundamental trade-off rather than a shortcoming of the approach.By leveraging per-channel scale selection and a combined loss function,DARE-Q provides a flexible trade-off between approximation accuracy and quantization error structure,creating an attractive algorithmic basis for further improvement of model compression methods.展开更多
Vision Transformers(ViTs)have achieved remarkable success across various artificial intelligence-based computer vision applications.However,their demanding computational and memory requirements pose significant challe...Vision Transformers(ViTs)have achieved remarkable success across various artificial intelligence-based computer vision applications.However,their demanding computational and memory requirements pose significant challenges for de-ployment on resource-constrained edge devices.Although post-training quantization(PTQ)provides a promising solution by reducing model precision with minimal calibration data,aggressive low-bit quantization typically leads to substantial perfor-mance degradation.To address this challenge,we present the truncated uniform-log2 quantizer and progressive bit-decline reconstruction method for vision Transformer quantization(TP-ViT).It is an innovative PTQ framework specifically designed for ViTs,featuring two key technical contributions:(1)truncated uniform-log2 quantizer,a novel quantization approach which effectively handles outlier values in post-Softmax activations,significantly reducing quantization errors;(2)bit-decline optimiza-tion strategy,which employs transition weights to gradually reduce bit precision while maintaining model performance under extreme quantization conditions.Comprehensive experiments on image classification,object detection,and instance segmenta-tion tasks demonstrate TP-ViT’s superior performance compared to state-of-the-art PTQ methods,particularly in challenging 3-bit quantization scenarios.Our framework achieves a notable 6.18 percentage points improvement in top-1 accuracy for ViT-small under 3-bit quantization.These results validate TP-ViT’s robustness and general applicability,paving the way for more efficient deployment of ViT models in computer vision applications on edge hardware.展开更多
The Internet of Things(IoT)technology provides data acquisition,transmission,and analysis to control rehabilitation robots,encompassing sensor data from the robots as well as lidar signals for trajectory planning(desi...The Internet of Things(IoT)technology provides data acquisition,transmission,and analysis to control rehabilitation robots,encompassing sensor data from the robots as well as lidar signals for trajectory planning(desired trajectory).In IoT rehabilitation robot systems,managing nonvanishing uncertainties and input quantization is crucial for precise and reliable control performance.These challenges can cause instability and reduced effectiveness,particularly in adaptive networked control.This paper investigates networked control with guaranteed performance for IoT rehabilitation robots under nonvanishing uncertainties and input quantization.First,input quantization is managed via a quantization-aware control design,ensur stability and minimizing tracking errors,even with discrete control inputs,to avoid chattering.Second,the method handles nonvanishing uncertainties by adjusting control parameters via real-time neural network adaptation,maintaining consistent performance despite persistent disturbances.Third,the control scheme guarantees the desired tracking performance within a specified time,with all signals in the closed-loop system remaining uniformly bounded,offering a robust,reliable solution for IoT rehabilitation robot control.The simulation verifies the benefits and efficacy of the proposed control strategy.展开更多
This paper proposes a novel method for the automatic diagnosis of keratitis using feature vector quantization and self-attention mechanisms(ADK_FVQSAM).First,high-level features are extracted using the DenseNet121 bac...This paper proposes a novel method for the automatic diagnosis of keratitis using feature vector quantization and self-attention mechanisms(ADK_FVQSAM).First,high-level features are extracted using the DenseNet121 backbone network,followed by adaptive average pooling to scale the features to a fixed length.Subsequently,product quantization with residuals(PQR)is applied to convert continuous feature vectors into discrete features representations,preserving essential information insensitive to image quality variations.The quantized and original features are concatenated and fed into a self-attention mechanism to capture keratitis-related features.Finally,these enhanced features are classified through a fully connected layer.Experiments on clinical low-quality(LQ)images show that ADK_FVQSAM achieves accuracies of 87.7%,81.9%,and 89.3% for keratitis,other corneal abnormalities,and normal corneas,respectively.Compared to DenseNet121,Swin transformer,and InceptionResNet,ADK_FVQSAM improves average accuracy by 3.1%,11.3%,and 15.3%,respectively.These results demonstrate that ADK_FVQSAM significantly enhances the recognition performance of keratitis based on LQ slit-lamp images,offering a practical approach for clinical application.展开更多
Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-div...Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-division multiplexing-based visible light communication(OFDM-VLC)system is presented.In order to analyze the effect of the resolution of ADC on NHS OFDM-VLC,a quantized mathematical model of NHS OFDM-VLC is established.Based on the proposed quantized model,a closed-form bit error rate(BER)expression is derived.The theoretical analysis and simulation results both confirm the effectiveness of the obtained BER formula in high-resolution ADC.In addition,channel coding is helpful in compensating for the BER performance loss due to the utilization of lower resolution ADC.展开更多
The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classificati...The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.展开更多
The high-efficiency video coder(HEVC)is one of the most advanced techniques used in growing real-time multimedia applications today.However,they require large bandwidth for transmission through bandwidth,and bandwidth...The high-efficiency video coder(HEVC)is one of the most advanced techniques used in growing real-time multimedia applications today.However,they require large bandwidth for transmission through bandwidth,and bandwidth varies with different video sequences/formats.This paper proposes an adaptive information-based variable quantization matrix(AIVQM)developed for different video formats having variable energy levels.The quantization method is adapted based on video sequence using statistical analysis,improving bit budget,quality and complexity reduction.Further,to have precise control over bit rate and quality,a multi-constraint prune algorithm is proposed in the second stage of the AI-VQM technique for pre-calculating K numbers of paths.The same should be handy to selfadapt and choose one of the K-path automatically in dynamically changing bandwidth availability as per requirement after extensive testing of the proposed algorithm in the multi-constraint environment for multiple paths and evaluating the performance based on peak signal to noise ratio(PSNR),bit-budget and time complexity for different videos a noticeable improvement in rate-distortion(RD)performance is achieved.Using the proposed AIVQM technique,more feasible and efficient video sequences are achieved with less loss in PSNR than the variable quantization method(VQM)algorithm with approximately a rise of 10%–20%based on different video sequences/formats.展开更多
The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to d...The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.展开更多
This paper applies the analytical transfer matrix method (ATMM) to calculate energy eigenvalues of a particle in low dimensional sharp confining potential for the first time, and deduces the quantization rules of th...This paper applies the analytical transfer matrix method (ATMM) to calculate energy eigenvalues of a particle in low dimensional sharp confining potential for the first time, and deduces the quantization rules of this system. It presents three cases in which the applied method works very well. In the first quantum dot, the energy eigenvalues and eigenfunction are obtained, and compared with those acquired from the exact numerical analysis and the WKB (Wentzel, Kramers and Brillouin) method; in the second or the third case, we get the energy eigenvalues by the ATMM, and compare them with the EBK (Einstein, Brillouin and Keller) results or the wavefunction outcomes. From the comparisons, we find that the semiclassical method (WKB, EBK or wavefunction) is inexact in such systems.展开更多
Federated Learning(FL)is an emerging machine learning framework designed to preserve privacy.However,the continuous updating of model parameters over uplink channels with limited throughput leads to a huge communicati...Federated Learning(FL)is an emerging machine learning framework designed to preserve privacy.However,the continuous updating of model parameters over uplink channels with limited throughput leads to a huge communication overload,which is a major challenge for FL.To address this issue,we propose an adaptive gradient quantization approach that enhances communication efficiency.Aiming to minimize the total communication costs,we consider both the correlation of gradients between local clients and the correlation of gradients between communication rounds,namely,in the time and space dimensions.The compression strategy is based on rate distortion theory,which allows us to find an optimal quantization strategy for the gradients.To further reduce the computational complexity,we introduce the Kalman filter into the proposed approach.Finally,numerical results demonstrate the effectiveness and robustness of the proposed rate-distortion optimization adaptive gradient quantization approach in significantly reducing the communication costs when compared to other quantization methods.展开更多
Many classical encoding algorithms of vector quantization (VQ) of image compression that can obtain global optimal solution have computational complexity O(N). A pure quantum VQ encoding algorithm with probability...Many classical encoding algorithms of vector quantization (VQ) of image compression that can obtain global optimal solution have computational complexity O(N). A pure quantum VQ encoding algorithm with probability of success near 100% has been proposed, that performs operations 45√N times approximately. In this paper, a hybrid quantum VQ encoding algorithm between the classical method and the quantum algorithm is presented. The number of its operations is less than √N for most images, and it is more efficient than the pure quantum algorithm.展开更多
This paper is concerned with the problem of finitetime control for a class of discrete-time networked systems.The measurement output and control input signals are quantized before being transmitted in communication ne...This paper is concerned with the problem of finitetime control for a class of discrete-time networked systems.The measurement output and control input signals are quantized before being transmitted in communication network.The quantization density of the network is assumed to be variable depending on the throughputs of network for the sake of congestion avoidance.The variation of the quantization density modes satisfies persistent dwell-time(PDT)switching which is more general than dwell-time switching in networked channels.By using a quantization-error-dependent Lyapunov function approach,sufficient conditions are given to ensure that the quantized systems are finite-time stable and finite-time bounded with a prescribed H∞performance,upon which a set of controllers depending on the mode of quantization density are designed.In order to show the effectiveness of the designed H_∞controller,we apply the developed theoretical results to a numerical example.展开更多
Detrended fluctuation analysis (DFA) is a method foro estimating the long-range power-law correlation exponent in noisy signals. It has been used successfully in many different fields, especially in the research of ...Detrended fluctuation analysis (DFA) is a method foro estimating the long-range power-law correlation exponent in noisy signals. It has been used successfully in many different fields, especially in the research of physiological signals. As an inherent part of these studies, quantization of continuous signals is inevitable. In addition, coarse-graining, to transfer original signals into symbol series in symbolic dynamic analysis, can also be considered as a quantization-like operation. Therefore, it is worth considering whether the quantization of signal has any effect on the result of DFA and if so, how large the effect will be. In this paper we study how the quantized degrees for three types of noise series (anti-correlated, uncorrelated and long-range power-law correlated signals) affect the results of DFA and find that their effects are completely different. The conclusion has an essential value in choosing the resolution of data acquisition instrument and in the processing of coarse-graining of signals.展开更多
By extending the usual Weyl transformation to the s-parameterized Weyl transformation with s being a real parameter,we obtain the s-parameterized quantization scheme which includes P–Q quantization, Q–P quantization...By extending the usual Weyl transformation to the s-parameterized Weyl transformation with s being a real parameter,we obtain the s-parameterized quantization scheme which includes P–Q quantization, Q–P quantization, and Weyl ordering as its three special cases. Some operator identities can be derived directly by virtue of the s-parameterized quantization scheme.展开更多
For a mesoscopic L-C circuit,besides the Louisell's quantization scheme in which electric charge q andelectric current I are respectively quantized as the coordinate operator Q and momentum operator P,in this pape...For a mesoscopic L-C circuit,besides the Louisell's quantization scheme in which electric charge q andelectric current I are respectively quantized as the coordinate operator Q and momentum operator P,in this paperwe propose a new quantization scheme in the context of number-phase quantization through the standard Lagrangianformalism.The comparison between this number-phase quantization with the Josephson junction's Cooper pair number-phase-difference quantization scheme is made.展开更多
Conventional quantization index modulation(QIM)watermarking uses the fixed quantization step size for the host signal.This scheme is not robust against geometric distortions and may lead to poor fidelity in some areas...Conventional quantization index modulation(QIM)watermarking uses the fixed quantization step size for the host signal.This scheme is not robust against geometric distortions and may lead to poor fidelity in some areas of content.Thus,we proposed a quantization-based image watermarking in the dual tree complex wavelet domain.We took advantages of the dual tree complex wavelets(perfect reconstruction,approximate shift invariance,and directional selectivity).For the case of watermark detecting,the probability of false alarm and probability of false negative were exploited and verified by simulation.Experimental results demonstrate that the proposed method is robust against JPEG compression,additive white Gaussian noise(AWGN),and some kinds of geometric attacks such as scaling,rotation,etc.展开更多
The digital measurement and processing is an important direction in the measurement and control field. The quantization error widely existing in the digital processing is always the decisive factor that restricts the ...The digital measurement and processing is an important direction in the measurement and control field. The quantization error widely existing in the digital processing is always the decisive factor that restricts the development and applications of the digital technology. In this paper, we find that the stability of the digital quantization system is obviously better than the quantization resolution. The application of a border effect in the digital quantization can greatly improve the accuracy of digital processing. Its effective precision has nothing to do with the number of quantization bits, which is only related to the stability of the quantization system. The high precision measurement results obtained in the low level quantization system with high sampling rate have an important application value for the progress in the digital measurement and processing field.展开更多
In this article, we use the general method of quantization by Drinfeld’s twist to quantize explicitly the Lie bialgebra structures on Lie algebras of Block type.
摘要This paper introduces MobiIris,a lightweight deep network for mobile iris recognition that enhances attention and specifically addresses the balance between accuracy and efficiency on devices with limited resources.The proposed model is based on the large version of MobileNetV3 and adds more spatial attention blocks and an embedding-based head that was trained using margin-based triplet learning,enabling fine-grained modeling of iris textures in a compact representation.To further improve discriminability,we design a training pipeline that combines dynamic-margin triplet loss,a staged hard/semi-hard negative mining strategy,and feature-level knowledge distillation from a ResNet-50 teacher.Finally,we investigate the use of post-training float16 quantization to reduce memory footprint and latency for deployment on mobile hardware.Experiments on the challenging CASIA-IrisV4-Thousand dataset show that the full-precision MobiIris model requires only 12 MB of storage and 27 ms inference latency,while achieving an EER of 1.409%,VR@FAR=1%of 98.184%,and CMC@1 of 94.785%,closely matching a ResNet-50 baseline that is more than 7×larger and slower.Under post-training quantization,the model shrinks to 5.94 MB with 13 ms latency and maintains a competitive balance between accuracy and efficiency compared to other optimized variants.These results demonstrate that a coherent combination of lightweight architecture design,attention mechanisms,metric-learning objectives,hard negative mining,and knowledge distillation yields a practical iris recognition solution suitable for secure,real-time authentication on mobile and embedded platforms.
基金supported by the National Natural Science Foundation of China(Grant Nos.12522411,12304049,and 12474240 for H.W.,92265203 and 12488101 for K.C.)the Strategic Priority Research Program of the Chinese Academy of Sciences(Grant Nos.XDB28000000 and XDB0460000 for K.C.)+1 种基金the Innovation Program for Quantum Science and Technology(Grant No.2024ZD0300104 for K.C.)the Fundamental Research Funds for the Central Universities(for H.W.)。
摘要We present the geodesic nature and quantization of geometric shift vector in quantum systems,with the parameter space defined by the Bloch momentum,using the Wilson loop approach.Our analysis extends to include bosonic phonon drag shift vectors with non-vertical transitions.We demonstrate that the gauge invariant shift vector can be quantized as integer values,analogous to the Euler characteristic based on the Gauss-Bonnet theorem for a manifold with a smooth boundary.We reveal intricate relationships among geometric quantities such as the shift vector,Berry curvature,and quantum metric.Our findings demonstrate that the loop integral of the shift vector in the quantized interband formula contributes to the non-quantized component of the trace of conductivity in the circular photogalvanic effect.The Wilson loop method facilitates first-principles calculations,providing insights in the geometric underpinnings of these interband gauge invariant quantities and shedding light on their nonlinear optical manifestations in real materials.
基金supported by grant No.25-71-10012 from the Russian Science Foundation,http://gffzz5363282ec1d94f2dsc5n6xocqubkq6nuu.ffgz.tsg.suse.edu.cn/project/25-71-10012/.
摘要We introduce the DARE-Q(Distribution-Aware Residual Entropy Quantization)method—a post-training quantization method for neural network weights designed to reduce bit-width with minimal degradation of model quality.Unlike traditional approaches that solely optimize the mean squared error of weight approximation,DARE-Q additionally considers the entropy of the quantization residual,allowing for control over the statistical properties of the resulting error.The method is based on channel-wise symmetric uniform quantization with scaling based on a combined loss function that includes L2 distortion and entropy regularization.The DARE-Q method is implemented as a compact DAREQuantLinear module which can be easily integrated into standard transformer pipelines without changing the inference logic or using specific kernels.The experimental analysis was conducted on the language models facebook/opt-125m and facebook/opt-350m,which contain approximately 125 and 350 million parameters.The quality of the models was assessed using the standard perplexity metric(PPL)computed on the wikitext-2-raw-v1 dataset.DARE-Q is completely data-free and does not require model retraining or calibration data,which makes it the only viable option in privacy-sensitive or confidential environments where access to the original training data is restricted—precisely the setting where methods such as GPTQ and AWQ cannot be applied.The observed increase in PPL relative to data-dependent baselines reflects this fundamental trade-off rather than a shortcoming of the approach.By leveraging per-channel scale selection and a combined loss function,DARE-Q provides a flexible trade-off between approximation accuracy and quantization error structure,creating an attractive algorithmic basis for further improvement of model compression methods.
基金supported by the National Natural Science Foundation of China(Nos.62301092 and 62301093).
摘要Vision Transformers(ViTs)have achieved remarkable success across various artificial intelligence-based computer vision applications.However,their demanding computational and memory requirements pose significant challenges for de-ployment on resource-constrained edge devices.Although post-training quantization(PTQ)provides a promising solution by reducing model precision with minimal calibration data,aggressive low-bit quantization typically leads to substantial perfor-mance degradation.To address this challenge,we present the truncated uniform-log2 quantizer and progressive bit-decline reconstruction method for vision Transformer quantization(TP-ViT).It is an innovative PTQ framework specifically designed for ViTs,featuring two key technical contributions:(1)truncated uniform-log2 quantizer,a novel quantization approach which effectively handles outlier values in post-Softmax activations,significantly reducing quantization errors;(2)bit-decline optimiza-tion strategy,which employs transition weights to gradually reduce bit precision while maintaining model performance under extreme quantization conditions.Comprehensive experiments on image classification,object detection,and instance segmenta-tion tasks demonstrate TP-ViT’s superior performance compared to state-of-the-art PTQ methods,particularly in challenging 3-bit quantization scenarios.Our framework achieves a notable 6.18 percentage points improvement in top-1 accuracy for ViT-small under 3-bit quantization.These results validate TP-ViT’s robustness and general applicability,paving the way for more efficient deployment of ViT models in computer vision applications on edge hardware.
基金supported in part by the National Natural Science Foundation of China under Grant 62302475in part by the Research Funds of Centre for Leading Medicine and Advanced Technologies of IHM under Grant 2023IHM01081 and 2023IHM01085+1 种基金in part by the Hefei Municipal Natural Science Foundation under Grant 202328partly by the Anhui Science and Technology Innovation Tackling Plan Project under Grant 202423k09020044。
摘要The Internet of Things(IoT)technology provides data acquisition,transmission,and analysis to control rehabilitation robots,encompassing sensor data from the robots as well as lidar signals for trajectory planning(desired trajectory).In IoT rehabilitation robot systems,managing nonvanishing uncertainties and input quantization is crucial for precise and reliable control performance.These challenges can cause instability and reduced effectiveness,particularly in adaptive networked control.This paper investigates networked control with guaranteed performance for IoT rehabilitation robots under nonvanishing uncertainties and input quantization.First,input quantization is managed via a quantization-aware control design,ensur stability and minimizing tracking errors,even with discrete control inputs,to avoid chattering.Second,the method handles nonvanishing uncertainties by adjusting control parameters via real-time neural network adaptation,maintaining consistent performance despite persistent disturbances.Third,the control scheme guarantees the desired tracking performance within a specified time,with all signals in the closed-loop system remaining uniformly bounded,offering a robust,reliable solution for IoT rehabilitation robot control.The simulation verifies the benefits and efficacy of the proposed control strategy.
基金supported by the National Natural Science Foundation of China(Nos.62276210,82201148 and 62376215)the Key Research and Development Project of Shaanxi Province(No.2025CY-YBXM-044)+3 种基金the Natural Science Foundation of Zhejiang Province(No.LQ22H120002)the Medical Health Science and Technology Project of Zhejiang Province(Nos.2022RC069 and 2023KY1140)the Natural Science Foundation of Ningbo(No.2023J390)the Ningbo Top Medical and Health Research Program(No.2023030716).
摘要This paper proposes a novel method for the automatic diagnosis of keratitis using feature vector quantization and self-attention mechanisms(ADK_FVQSAM).First,high-level features are extracted using the DenseNet121 backbone network,followed by adaptive average pooling to scale the features to a fixed length.Subsequently,product quantization with residuals(PQR)is applied to convert continuous feature vectors into discrete features representations,preserving essential information insensitive to image quality variations.The quantized and original features are concatenated and fed into a self-attention mechanism to capture keratitis-related features.Finally,these enhanced features are classified through a fully connected layer.Experiments on clinical low-quality(LQ)images show that ADK_FVQSAM achieves accuracies of 87.7%,81.9%,and 89.3% for keratitis,other corneal abnormalities,and normal corneas,respectively.Compared to DenseNet121,Swin transformer,and InceptionResNet,ADK_FVQSAM improves average accuracy by 3.1%,11.3%,and 15.3%,respectively.These results demonstrate that ADK_FVQSAM significantly enhances the recognition performance of keratitis based on LQ slit-lamp images,offering a practical approach for clinical application.
基金supported by the National Natural Science Foundation of China(No.62201508)the Zhejiang Provincial Natural Science Foundation of China(Nos.LZ21F010001 and LQ23F010004)the State Key Laboratory of Millimeter Waves of Southeast University,China(No.K202212).
摘要Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-division multiplexing-based visible light communication(OFDM-VLC)system is presented.In order to analyze the effect of the resolution of ADC on NHS OFDM-VLC,a quantized mathematical model of NHS OFDM-VLC is established.Based on the proposed quantized model,a closed-form bit error rate(BER)expression is derived.The theoretical analysis and simulation results both confirm the effectiveness of the obtained BER formula in high-resolution ADC.In addition,channel coding is helpful in compensating for the BER performance loss due to the utilization of lower resolution ADC.
摘要The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.
摘要The high-efficiency video coder(HEVC)is one of the most advanced techniques used in growing real-time multimedia applications today.However,they require large bandwidth for transmission through bandwidth,and bandwidth varies with different video sequences/formats.This paper proposes an adaptive information-based variable quantization matrix(AIVQM)developed for different video formats having variable energy levels.The quantization method is adapted based on video sequence using statistical analysis,improving bit budget,quality and complexity reduction.Further,to have precise control over bit rate and quality,a multi-constraint prune algorithm is proposed in the second stage of the AI-VQM technique for pre-calculating K numbers of paths.The same should be handy to selfadapt and choose one of the K-path automatically in dynamically changing bandwidth availability as per requirement after extensive testing of the proposed algorithm in the multi-constraint environment for multiple paths and evaluating the performance based on peak signal to noise ratio(PSNR),bit-budget and time complexity for different videos a noticeable improvement in rate-distortion(RD)performance is achieved.Using the proposed AIVQM technique,more feasible and efficient video sequences are achieved with less loss in PSNR than the variable quantization method(VQM)algorithm with approximately a rise of 10%–20%based on different video sequences/formats.
摘要The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.
摘要This paper applies the analytical transfer matrix method (ATMM) to calculate energy eigenvalues of a particle in low dimensional sharp confining potential for the first time, and deduces the quantization rules of this system. It presents three cases in which the applied method works very well. In the first quantum dot, the energy eigenvalues and eigenfunction are obtained, and compared with those acquired from the exact numerical analysis and the WKB (Wentzel, Kramers and Brillouin) method; in the second or the third case, we get the energy eigenvalues by the ATMM, and compare them with the EBK (Einstein, Brillouin and Keller) results or the wavefunction outcomes. From the comparisons, we find that the semiclassical method (WKB, EBK or wavefunction) is inexact in such systems.
基金supported in part by the Key Research and Development Program of Jiangsu Province(Grant No.BE2020084-2)in part by the National Key Research and Development Program of China(Grant No.2020YFB1600104)+4 种基金in part by the Key Research and Development Special Project of school and local cooperation in Lvliang(Grant No.2023XDHZ18)in part by Southeast University-China Mobile Research Institute Joint Innovation Centerin part by the National Natural Science Foundation of China(Grant No.62371119)in part by the Key Research and Development Program of Jiangsu Province(Grant No.BE2022059-3)in part by the Zhi Shan Young Scholar Program of Southeast University。
摘要Federated Learning(FL)is an emerging machine learning framework designed to preserve privacy.However,the continuous updating of model parameters over uplink channels with limited throughput leads to a huge communication overload,which is a major challenge for FL.To address this issue,we propose an adaptive gradient quantization approach that enhances communication efficiency.Aiming to minimize the total communication costs,we consider both the correlation of gradients between local clients and the correlation of gradients between communication rounds,namely,in the time and space dimensions.The compression strategy is based on rate distortion theory,which allows us to find an optimal quantization strategy for the gradients.To further reduce the computational complexity,we introduce the Kalman filter into the proposed approach.Finally,numerical results demonstrate the effectiveness and robustness of the proposed rate-distortion optimization adaptive gradient quantization approach in significantly reducing the communication costs when compared to other quantization methods.
摘要Many classical encoding algorithms of vector quantization (VQ) of image compression that can obtain global optimal solution have computational complexity O(N). A pure quantum VQ encoding algorithm with probability of success near 100% has been proposed, that performs operations 45√N times approximately. In this paper, a hybrid quantum VQ encoding algorithm between the classical method and the quantum algorithm is presented. The number of its operations is less than √N for most images, and it is more efficient than the pure quantum algorithm.
摘要This paper is concerned with the problem of finitetime control for a class of discrete-time networked systems.The measurement output and control input signals are quantized before being transmitted in communication network.The quantization density of the network is assumed to be variable depending on the throughputs of network for the sake of congestion avoidance.The variation of the quantization density modes satisfies persistent dwell-time(PDT)switching which is more general than dwell-time switching in networked channels.By using a quantization-error-dependent Lyapunov function approach,sufficient conditions are given to ensure that the quantized systems are finite-time stable and finite-time bounded with a prescribed H∞performance,upon which a set of controllers depending on the mode of quantization density are designed.In order to show the effectiveness of the designed H_∞controller,we apply the developed theoretical results to a numerical example.
基金Project supported by the Natural Science Foundation for the Returned Overseas Chinese Scholars of the Ministry of Human Resources of China (Grant No. 2008102SB90203)Nanjing Normal University,China (Grant No. 2008102XLH0044)
摘要Detrended fluctuation analysis (DFA) is a method foro estimating the long-range power-law correlation exponent in noisy signals. It has been used successfully in many different fields, especially in the research of physiological signals. As an inherent part of these studies, quantization of continuous signals is inevitable. In addition, coarse-graining, to transfer original signals into symbol series in symbolic dynamic analysis, can also be considered as a quantization-like operation. Therefore, it is worth considering whether the quantization of signal has any effect on the result of DFA and if so, how large the effect will be. In this paper we study how the quantized degrees for three types of noise series (anti-correlated, uncorrelated and long-range power-law correlated signals) affect the results of DFA and find that their effects are completely different. The conclusion has an essential value in choosing the resolution of data acquisition instrument and in the processing of coarse-graining of signals.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.11147009,11347026,and 11244005)the Natural Science Foundation of Shandong Province,China(Grant Nos.ZR2013AM012 and ZR2012AM004)the Natural Science Foundation of Liaocheng University,China
摘要By extending the usual Weyl transformation to the s-parameterized Weyl transformation with s being a real parameter,we obtain the s-parameterized quantization scheme which includes P–Q quantization, Q–P quantization, and Weyl ordering as its three special cases. Some operator identities can be derived directly by virtue of the s-parameterized quantization scheme.
基金The project supported by the President Foundation of the Chinese Academy of Sciences
摘要For a mesoscopic L-C circuit,besides the Louisell's quantization scheme in which electric charge q andelectric current I are respectively quantized as the coordinate operator Q and momentum operator P,in this paperwe propose a new quantization scheme in the context of number-phase quantization through the standard Lagrangianformalism.The comparison between this number-phase quantization with the Josephson junction's Cooper pair number-phase-difference quantization scheme is made.
基金supported by a grant from the National High Technology Research and Development Program of China(863 Program)(No.2008AA04A107)supported by a grant from the Major Programs of Guangdong-Hongkong in the Key Domain(No.2009498B21)
摘要Conventional quantization index modulation(QIM)watermarking uses the fixed quantization step size for the host signal.This scheme is not robust against geometric distortions and may lead to poor fidelity in some areas of content.Thus,we proposed a quantization-based image watermarking in the dual tree complex wavelet domain.We took advantages of the dual tree complex wavelets(perfect reconstruction,approximate shift invariance,and directional selectivity).For the case of watermark detecting,the probability of false alarm and probability of false negative were exploited and verified by simulation.Experimental results demonstrate that the proposed method is robust against JPEG compression,additive white Gaussian noise(AWGN),and some kinds of geometric attacks such as scaling,rotation,etc.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.10978017 and 61201288)Shaanxi Natural Science Foundation Research Plan Projects,China(Grant No.2014JM2-6128)Shaanxi Major Technological Achievements Transformation and Guidance Special Projects,China(Grant No.2015KTCG01-01)
摘要The digital measurement and processing is an important direction in the measurement and control field. The quantization error widely existing in the digital processing is always the decisive factor that restricts the development and applications of the digital technology. In this paper, we find that the stability of the digital quantization system is obviously better than the quantization resolution. The application of a border effect in the digital quantization can greatly improve the accuracy of digital processing. Its effective precision has nothing to do with the number of quantization bits, which is only related to the stability of the quantization system. The high precision measurement results obtained in the low level quantization system with high sampling rate have an important application value for the progress in the digital measurement and processing field.
基金supported by the National Science Foundation of China (10825101)"One Hundred Talents Program" from University of Science and Technology of Chinathe China Postdoctoral Science Foundation (20090450810)
摘要In this article, we use the general method of quantization by Drinfeld’s twist to quantize explicitly the Lie bialgebra structures on Lie algebras of Block type.