Entropy, Relative Entropy, Mutual Information
Revision as of 12:41, 25 June 2020 by Louis Alarcon (talk | contribs) (Created page with "== Definitions == === Entropy === * a measure of the uncertainty of a random variable * The entropy of a random variable is a measure of the uncertainty of the random variabl...")
Definitions
Entropy
- a measure of the uncertainty of a random variable
- The entropy of a random variable is a measure of the uncertainty of the random variable
- it is a measure of the amount of information required on the average to describe the random variable
