Fuzzy entropy was designed for non convex fuzzy membership function using well known Hamming distance measure.The proposed fuzzy entropy had the same structure as that of convex fuzzy membership case.Design procedure ...Fuzzy entropy was designed for non convex fuzzy membership function using well known Hamming distance measure.The proposed fuzzy entropy had the same structure as that of convex fuzzy membership case.Design procedure of fuzzy entropy was proposed by considering fuzzy membership through distance measure,and the obtained results contained more flexibility than the general fuzzy membership function.Furthermore,characteristic analyses for non convex function were also illustrated.Analyses on the mutual information were carried out through the proposed fuzzy entropy and similarity measure,which was also dual structure of fuzzy entropy.By the illustrative example,mutual information was discussed.展开更多
Incremental image compression techniques using priori information are of significance to deal with the explosively increasing remote-sensing image data. However, the potential benefi ts of priori information are still...Incremental image compression techniques using priori information are of significance to deal with the explosively increasing remote-sensing image data. However, the potential benefi ts of priori information are still to be evaluated quantitatively for effi cient compression scheme designing. In this paper, we present a k-nearest neighbor(k-NN) based bypass image entropy estimation scheme, together with the corresponding mutual information estimation method. Firstly, we apply the k-NN entropy estimation theory to split image blocks, describing block-wise intra-frame spatial correlation while avoiding the curse of dimensionality. Secondly, we propose the corresponding mutual information estimator based on feature-based image calibration and straight-forward correlation enhancement. The estimator is designed to evaluate the compression performance gain of using priori information. Numerical results on natural and remote-sensing images show that the proposed scheme obtains an estimation accuracy gain by 10% compared with conventional image entropy estimators. Furthermore, experimental results demonstrate both the effectiveness of the proposed mutual information evaluation scheme, and the quantitative incremental compressibility by using the priori remote-sensing frames.展开更多
With the development of methods for predicting extreme hydrological elements using probabilistic approaches,several commonly used methods have emerged for analyzing the risk of storm surge disasters,including the Annu...With the development of methods for predicting extreme hydrological elements using probabilistic approaches,several commonly used methods have emerged for analyzing the risk of storm surge disasters,including the Annual Maxima method,the Peak-Over-Threshold method,the Gumbel distribution,and the Weibull distribution.Meanwhile,and emphases have been placed on assessing and comparing the applicability and stability of these various methods.To evaluate the rationality of different methods,we an entropy uncertainty analysis method was introduced based on information utilization efficiency,in which the sample Stochastic uncertainty is measured by the ratio of information entropy before and after sampling,i.e.,the information extraction efficiency of the sampling method.Additionally,the cognitive uncertainty of the research method is assessed by the ratio of mutual information between the model and the sample to the information entropy of the sample,i.e.,the information extraction efficiency of the mathematical model.Furthermore,we incorporated the group probability calculation method,information entropy and mutual information theory to analyze and calculate the entropy uncertainty more accurately.By applying this analysis to the design wave height and the recurrence period projected in the sea area west Guangdong of China,we believed that the most reasonable hazard assessment method shall be based on the over-threshold method combined with the Pareto distribution.Conversely,the assessment method based on the process extreme value method is deemed insufficiently reasonable and requires further research.展开更多
In this paper,we introduce and investigate the mutual information and relative entropy on the sequentialeffect algebra,we also give a comparison of these mutual information and relative entropy with the classical ones...In this paper,we introduce and investigate the mutual information and relative entropy on the sequentialeffect algebra,we also give a comparison of these mutual information and relative entropy with the classical ones by thevenn diagrams.Finally,a nice example shows that the entropies of sequential effect algebra depend extremely on theorder of its sequential product.展开更多
For the study of internal combustion engines,combustion control is an important method to achieve high efficiency and low emissions.Currently,in-cylinder pressure sensor-based closed-loop control strategies have becom...For the study of internal combustion engines,combustion control is an important method to achieve high efficiency and low emissions.Currently,in-cylinder pressure sensor-based closed-loop control strategies have become the preferred solution.However,their productional application in automotive industries is limited due to the cost of intensive pressure acquisition for a whole cycle and the calculation load of combustion phase indicators.This paper proposes a method of combustion phase estimation for spark ignition(SI)engines.In this method,the combustion phase is estimated only based on pressure measurements at several crank angles.Information entropy and mutual information are introduced to analyze the feasibility and accuracy of the combustion phase estimation,which shows that the pressure measurements at selected points contain most of the information for the estimation.As a result,only pressure measurements at 3 points and ELM estimation models are required to obtain the combustion phase,instead of intensive data acquisition and calculation.展开更多
We propose a novel measure to assess causality through the comparison of symbolic mutual information between the future of one random quantity and the past of the other.This provides a new perspective that is differen...We propose a novel measure to assess causality through the comparison of symbolic mutual information between the future of one random quantity and the past of the other.This provides a new perspective that is different from the conventional conceptions.Based on this point of view,a new causality index is derived that uses the definition of directional symbolic mutual information.This measure presents properties that are different from the time delayed mutual information since the symbolization captures the dynamic features of the analyzed time series.In addition to characterizing the direction and the amplitude of the information flow,it can also detect coupling delays.This method has the property of robustness,conceptual simplicity,and fast computational speed.展开更多
A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. ...A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. In this maximization process optimal values of five parameters of an affine transformation are searched.展开更多
提升精细化的光伏预测技术对电力系统的实时调度运行至关重要。它不仅依赖于预测模型的优劣,还依赖于训练样本日与预测日的相似程度。提出一种基于MIE-LSTM的短期光伏功率预测方法。在建立基于互信息熵(Mutual Information Entropy, MIE...提升精细化的光伏预测技术对电力系统的实时调度运行至关重要。它不仅依赖于预测模型的优劣,还依赖于训练样本日与预测日的相似程度。提出一种基于MIE-LSTM的短期光伏功率预测方法。在建立基于互信息熵(Mutual Information Entropy, MIE)的相关性衡量指标基础上,计算出光伏功率与各气象因素间的互信息熵,从而对高维气象数据进行降维处理。然后,利用历史日与预测日多维气象因素间的加权互信息熵筛选出相似日样本。最后,通过长短期记忆(Long-short Term Memory, LSTM)神经网络预测模型训练并建立气象因素与光伏出力之间的映射关系。通过对某实测光伏电站不同天气类型下的发电功率进行预测分析,验证了新方法能够达到理想的预测精度。展开更多
To evaluate the wear condition of machines accurately,oil spectrographic entropy,mutual information and ICA analysis methods based on information theory are presented. A full-scale diagnosis utilizing all channels of ...To evaluate the wear condition of machines accurately,oil spectrographic entropy,mutual information and ICA analysis methods based on information theory are presented. A full-scale diagnosis utilizing all channels of spectrographic analysis can be obtained. By measuring the complexity and correlativity,the characteristics of wear condition of machines can be shown clearly. The diagnostic quality is improved. The analysis processes of these monitoring methods are given through the explanation of examples. The availability of these methods is validated and further research fields are demonstrated.展开更多
Utilizing channel reciprocity, time reversal(TR) technique increases the signal-to-noise ratio(SNR) at the receiver with very low transmitter complexity in complex multipath environment. Present research works abo...Utilizing channel reciprocity, time reversal(TR) technique increases the signal-to-noise ratio(SNR) at the receiver with very low transmitter complexity in complex multipath environment. Present research works about TR multiple-input multiple-output(MIMO) communication all focus on the system implementation and network building. The aim of this work is to analyze the influence of antenna coupling on the capacity of wideband TR MIMO system, which is a realistic question in designing a practical communication system. It turns out that antenna coupling stabilizes the capacity in a small variation range with statistical wideband channel response. Meanwhile, antenna coupling only causes a slight detriment to the channel capacity in a wideband TR MIMO system. Comparatively, uncorrelated stochastic channels without coupling exhibit a wider range of random capacity distribution which greatly depends on the statistical channel. The conclusions drawn from information difference entropy theory provide a guideline for designing better high-performance wideband TR MIMO communication systems.展开更多
A novel method of constructing sentiment lexicon of new words(SLNW)is proposed to realize effective Weibo sentiment analysis by integrating existing lexicons of sentiments,lexicons of degree,negation and network.Based...A novel method of constructing sentiment lexicon of new words(SLNW)is proposed to realize effective Weibo sentiment analysis by integrating existing lexicons of sentiments,lexicons of degree,negation and network.Based on left-right entropy and mutual information(MI)neologism discovery algorithms,this new algorithm divides N-gram to obtain strings dynamically instead of relying on fixed sliding window when using Trie as data structure.The sentiment-oriented point mutual information(SO-PMI)algorithm with Laplacian smoothing is used to distinguish sentiment tendency of new words found in the data set to form SLNW by putting new words to basic sentiment lexicon.Experiments show that the sentiment analysis based on SLNW performs better than others.Precision,recall and F-measure are improved in both topic and non-topic Weibo data sets.展开更多
基金Work supported by the Second Stage of Brain Korea 21 Projects Work(2010-0020163) supported by the Priority Research Centers Program through the National Research Foundation (NRF) funded by the Ministry of Education,Science and Technology of Korea
摘要Fuzzy entropy was designed for non convex fuzzy membership function using well known Hamming distance measure.The proposed fuzzy entropy had the same structure as that of convex fuzzy membership case.Design procedure of fuzzy entropy was proposed by considering fuzzy membership through distance measure,and the obtained results contained more flexibility than the general fuzzy membership function.Furthermore,characteristic analyses for non convex function were also illustrated.Analyses on the mutual information were carried out through the proposed fuzzy entropy and similarity measure,which was also dual structure of fuzzy entropy.By the illustrative example,mutual information was discussed.
基金supported by National Basic Research Project of China(2013CB329006)National Natural Science Foundation of China(No.61622110,No.61471220,No.91538107)
摘要Incremental image compression techniques using priori information are of significance to deal with the explosively increasing remote-sensing image data. However, the potential benefi ts of priori information are still to be evaluated quantitatively for effi cient compression scheme designing. In this paper, we present a k-nearest neighbor(k-NN) based bypass image entropy estimation scheme, together with the corresponding mutual information estimation method. Firstly, we apply the k-NN entropy estimation theory to split image blocks, describing block-wise intra-frame spatial correlation while avoiding the curse of dimensionality. Secondly, we propose the corresponding mutual information estimator based on feature-based image calibration and straight-forward correlation enhancement. The estimator is designed to evaluate the compression performance gain of using priori information. Numerical results on natural and remote-sensing images show that the proposed scheme obtains an estimation accuracy gain by 10% compared with conventional image entropy estimators. Furthermore, experimental results demonstrate both the effectiveness of the proposed mutual information evaluation scheme, and the quantitative incremental compressibility by using the priori remote-sensing frames.
基金Supported by the National Natural Science Foundation of China(No.52071306)。
摘要With the development of methods for predicting extreme hydrological elements using probabilistic approaches,several commonly used methods have emerged for analyzing the risk of storm surge disasters,including the Annual Maxima method,the Peak-Over-Threshold method,the Gumbel distribution,and the Weibull distribution.Meanwhile,and emphases have been placed on assessing and comparing the applicability and stability of these various methods.To evaluate the rationality of different methods,we an entropy uncertainty analysis method was introduced based on information utilization efficiency,in which the sample Stochastic uncertainty is measured by the ratio of information entropy before and after sampling,i.e.,the information extraction efficiency of the sampling method.Additionally,the cognitive uncertainty of the research method is assessed by the ratio of mutual information between the model and the sample to the information entropy of the sample,i.e.,the information extraction efficiency of the mathematical model.Furthermore,we incorporated the group probability calculation method,information entropy and mutual information theory to analyze and calculate the entropy uncertainty more accurately.By applying this analysis to the design wave height and the recurrence period projected in the sea area west Guangdong of China,we believed that the most reasonable hazard assessment method shall be based on the over-threshold method combined with the Pareto distribution.Conversely,the assessment method based on the process extreme value method is deemed insufficiently reasonable and requires further research.
基金Supported by Research Foundation of Kumoh National Institute of Technology
摘要In this paper,we introduce and investigate the mutual information and relative entropy on the sequentialeffect algebra,we also give a comparison of these mutual information and relative entropy with the classical ones by thevenn diagrams.Finally,a nice example shows that the entropies of sequential effect algebra depend extremely on theorder of its sequential product.
摘要For the study of internal combustion engines,combustion control is an important method to achieve high efficiency and low emissions.Currently,in-cylinder pressure sensor-based closed-loop control strategies have become the preferred solution.However,their productional application in automotive industries is limited due to the cost of intensive pressure acquisition for a whole cycle and the calculation load of combustion phase indicators.This paper proposes a method of combustion phase estimation for spark ignition(SI)engines.In this method,the combustion phase is estimated only based on pressure measurements at several crank angles.Information entropy and mutual information are introduced to analyze the feasibility and accuracy of the combustion phase estimation,which shows that the pressure measurements at selected points contain most of the information for the estimation.As a result,only pressure measurements at 3 points and ELM estimation models are required to obtain the combustion phase,instead of intensive data acquisition and calculation.
基金Project supported by the National Natural Science Foundation of China (Grant No. 60904039)
摘要We propose a novel measure to assess causality through the comparison of symbolic mutual information between the future of one random quantity and the past of the other.This provides a new perspective that is different from the conventional conceptions.Based on this point of view,a new causality index is derived that uses the definition of directional symbolic mutual information.This measure presents properties that are different from the time delayed mutual information since the symbolization captures the dynamic features of the analyzed time series.In addition to characterizing the direction and the amplitude of the information flow,it can also detect coupling delays.This method has the property of robustness,conceptual simplicity,and fast computational speed.
摘要A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. In this maximization process optimal values of five parameters of an affine transformation are searched.
摘要提升精细化的光伏预测技术对电力系统的实时调度运行至关重要。它不仅依赖于预测模型的优劣,还依赖于训练样本日与预测日的相似程度。提出一种基于MIE-LSTM的短期光伏功率预测方法。在建立基于互信息熵(Mutual Information Entropy, MIE)的相关性衡量指标基础上,计算出光伏功率与各气象因素间的互信息熵,从而对高维气象数据进行降维处理。然后,利用历史日与预测日多维气象因素间的加权互信息熵筛选出相似日样本。最后,通过长短期记忆(Long-short Term Memory, LSTM)神经网络预测模型训练并建立气象因素与光伏出力之间的映射关系。通过对某实测光伏电站不同天气类型下的发电功率进行预测分析,验证了新方法能够达到理想的预测精度。
摘要To evaluate the wear condition of machines accurately,oil spectrographic entropy,mutual information and ICA analysis methods based on information theory are presented. A full-scale diagnosis utilizing all channels of spectrographic analysis can be obtained. By measuring the complexity and correlativity,the characteristics of wear condition of machines can be shown clearly. The diagnostic quality is improved. The analysis processes of these monitoring methods are given through the explanation of examples. The availability of these methods is validated and further research fields are demonstrated.
基金Project supported by the National Natural Science Foundation of China(Grant Nos.61331007,61361166008,and 61401065)the Specialized Research Fund for the Doctoral Program of Higher Education of China(Grant No.20120185130001)
摘要Utilizing channel reciprocity, time reversal(TR) technique increases the signal-to-noise ratio(SNR) at the receiver with very low transmitter complexity in complex multipath environment. Present research works about TR multiple-input multiple-output(MIMO) communication all focus on the system implementation and network building. The aim of this work is to analyze the influence of antenna coupling on the capacity of wideband TR MIMO system, which is a realistic question in designing a practical communication system. It turns out that antenna coupling stabilizes the capacity in a small variation range with statistical wideband channel response. Meanwhile, antenna coupling only causes a slight detriment to the channel capacity in a wideband TR MIMO system. Comparatively, uncorrelated stochastic channels without coupling exhibit a wider range of random capacity distribution which greatly depends on the statistical channel. The conclusions drawn from information difference entropy theory provide a guideline for designing better high-performance wideband TR MIMO communication systems.
基金Natural Science Foundation of Shanghai,China(No.18ZR1401200)Special Fund for Innovation and Development of Shanghai Industrial Internet,China(No.2019-GYHLW-01004)。
摘要A novel method of constructing sentiment lexicon of new words(SLNW)is proposed to realize effective Weibo sentiment analysis by integrating existing lexicons of sentiments,lexicons of degree,negation and network.Based on left-right entropy and mutual information(MI)neologism discovery algorithms,this new algorithm divides N-gram to obtain strings dynamically instead of relying on fixed sliding window when using Trie as data structure.The sentiment-oriented point mutual information(SO-PMI)algorithm with Laplacian smoothing is used to distinguish sentiment tendency of new words found in the data set to form SLNW by putting new words to basic sentiment lexicon.Experiments show that the sentiment analysis based on SLNW performs better than others.Precision,recall and F-measure are improved in both topic and non-topic Weibo data sets.