Why it matters
Entropy coding underlies compression. Understanding shapes theory + practice.
Advertisement
The architecture
Model symbol probabilities.
Encode with variable-length codes.
Trade compression + speed.
Advertisement
How it works end to end
Shannon entropy bound.
Arithmetic + range optimal.
Huffman fast + suboptimal.
ANS modern optimal + fast.