Mutual Information In probability theory and information theory
The definition of mutual information could resort to wiki:
http://en.wikipedia.org/wiki/Mutual_information
For marginal mutual information, we say it is :
I(A,B)=sum sum P(A,B) log[P(A,B)/P(A)P(B)]
For conditional mutual information, we say it is :
I(A,B|C)=sum sum P(A,B|C) log[P(A,B|C)/P(A|C)P(B|C)]
For mutual information matric, we say it is:
the matric saves all pairs of I(A,B)
Please refer to "ControlCentor.m", we have a simple example for you understanding. If there is any question, please let me know, i will help you as soon as possible.
PS: fast mex programming functions are provided for advance users here too
引用
Guangdi Li (2024). Mutual Information In probability theory and information theory (https://www.mathworks.com/matlabcentral/fileexchange/23274-mutual-information-in-probability-theory-and-information-theory), MATLAB Central File Exchange. 取得済み .
MATLAB リリースの互換性
プラットフォームの互換性
Windows macOS Linuxタグ
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!