information theory Shannon entropy classical
In classical information theory H, the Shannon entropy, is associated to a probability distribution, 




p

1


,
⋯
,

p

n




{\displaystyle p_{1},\cdots ,p_{n}}

, in the following way:
