Why it matters

Self-consistency is simple inference-time scaling. Understanding shapes basics.

Advertisement

The architecture

N parallel CoT samples.

Extract final answer from each.

Majority vote.

Self-consistency flowN CoT samplesdiverse temperatureExtract answerseach chainMajority voteconsensus answerWang et al. 2022; simple but effective; more sophisticated methods (BoN + verifier) improve
Self-consistency.
Advertisement

How it works end to end

Wang et al. 2022.

Temperature > 0 for diversity.

Extract answer via regex or LLM.

N = 5-40 typical.