How do we perform algebraic operations on the fundamental quantities of information theory?
In short: This lecture explores the mechanics of entropy and Shannon information. It is essential viewing for understanding how conditioning on random variables influences entropy and reveals the underlying relationships between different random outcomes.
In this second lecture of his third-year course, Sam Cohen examines the algebraic manipulation of information-theoretic quantities. The session focuses on the impact of conditioning on other random variables, providing a framework to analyze how these dependencies alter entropy.
The material is part of the Oxford Mathematics curriculum, where advanced lectures are supplemented by classes that allow students to deepen their engagement with the mathematical concepts presented.
Opens the Intellect+ feed with this card first. Swipe up for the next one.
Sources
- Summary by Intellect · source: Information Theory, Lecture 2: Basic Properties of Information - 3rd Year Student Lecture
To cite this card, link to https://intellectplus.co.uk/app/science-information-theory-lecture-2-basic-properties-of-information.
How we source, check and correct cards: Editorial standards.
General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.
Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?
Related
More in Entropy · More in Science · Latest · A–Z · All topics