Reading guide
Information theory measures uncertainty and the information carried by observations or messages. Probability is the starting point; entropy, coding, and communication provide the main direction for this collection. The current foundations page is an outline.