熵、条件熵、联合熵、互信息关系及例题
离散变量连续变量H(X)=∑xi∈XP(xi)log1P(xi)H(X)=\sum_{x_{i} \in X} P(x_{i}) \log \frac{1}{P(x_{i})}H(X)=∑xi∈XP(xi)logP(xi)1H(X)=∫P(x)⋅log1P(x)dxH(X)=\int P(x) \cdot \log \frac{1}{P(x)} d xH(X)=∫P(x)⋅logP(x)1dxH(X∣Y)=∑xi∈X∑yj∈YP(xi,yj)log1P(yj∣...
