Status

This is an explicit TODO scaffold, not a claim that the source chapter is complete. The archived source file currently provides only a chapter outline or a very small placeholder.

The source path is content/Part8 Basic Information Theory/Chapter1.tex. The source file is preserved in the locked repository snapshot Math-for-Computer-Science.

Source outline

  • Measuring Information
  • Information Entropy
  • Joint and Conditional Entropy
  • Cross Entropy and Relative Entropy
  • Mutual Information
  • Differential Entropy

Migration queue

  • Translate the source outline into a coherent note in the blog’s Markdown and KaTeX conventions.
  • Review definitions, notation, proofs, and examples against a reliable reference before promoting the page beyond seed maturity.
  • Convert or redraw any LaTeX-generated figures as SVG, or keep an explicit asset-pending placeholder.

This page belongs to the Information Theory reading path.