Why it matters

Inference scaling reshapes compute economics. Understanding shapes strategy.

Advertisement

The architecture

Longer reasoning chains.

Best-of-N + majority vote.

Tree / search.

Inference scaling approachesLonger CoTextended reasoningBest-of-Nsample + selectSearchMCTS + variantsOpenAI o1 + DeepSeek R1 + Anthropic reasoning families demonstrate scaling
Inference scaling.
Advertisement

How it works end to end

Snell et al. 2024 formalized.

Trade inference compute for training compute.

Works better on reasoning tasks.