Shannon Entropy

It is a measure of information entropy.

$$I=-(P_1{\log }_2{P}_1+P_2{\log }_2{P}_2+\cdots +P_k{\log }_2{P}_k)=-\sum _{i-1}^k{P}_i{\log }_2{P}_i$$