Beam Search Math

Why it matters

Beam search shapes deterministic decoding. Understanding shapes non-LLM.

The architecture

Maintain K beams.

Extend each by all tokens.

Keep top-K by cumulative log-prob.

How it works end to end

Length normalization prevents bias.

Diverse beam search variants.

Coverage penalty.