Mutual Information Is Copula Entropy

来源 :清华大学学报(英文版) | 被引量 : 0次 | 上传用户:bhf10116
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Mutual information (MI) is a basic concept in information theory. Therefore, estimates of the MI are fundamentally important in most information theory applications. This paper provides a new way of understanding and estimating the MI using the copula function. First, the entropy of the copula, named the copula entropy, is defined as a measure of the dependence uncertainty represented by the copula function and then the MI is shown to be equivalent to the negative copula entropy. With this equivalence, the MI can be estimated by first estimating the empirical copula and then estimating the entropy of the empirical copula.Thus, the MI estimate is an estimation of the entropy, which reduces the complexity and computational requirements. Tests show that the method is more effective than the traditional method.
其他文献
An expert system for biomass soft-sensor hybrid modeling in fermentation process was decribed in this paper. A production rules representation based on database
本文通过对荣华二采区10
Random vibration test was done on aluminum honeycomb sandwich board.The result suggested thatchaotic behavior is found in the test data.The Volterra expression
The ultrasonic assisted tungsten inert gas (U-TIG)welding is a newly developed arc welding method,which is aimed at improving the weld quality and efficiency.TI
A balancing problem for a mixed model assembly line with uncertain task processing time and daily model mixed changes is considered, and the objective is to min
This article investigated the implementation of AUV local planning under the strong sea flow field by integrating Q learning with fuzzy logic method.The dynamic
In the present paper, two- and three-tlimensional numerical simulations of the flow interference between four cylinders in an in-line square arrangement at Re =
In order to improve the network performance furthermore, a routing algorithm for 2D-Torus is investigated from the standpoint of load balance for virtual channe
The effect of niobium on the formation of NbC phase and solidification structure in high carbon equivalent grey cast iron was investigated. The experimental res
The flow process of unplasticized polyvinyl chloride(U-PVC)through the mixing zone of intermeshing counter-rotating and co-rotating twin-screw extruders(TSEs)we