Why it matters
Emergence explains why scale matters. Understanding shapes expectations.
Advertisement
The architecture
Small models: no ability.
Above threshold: ability appears.
Cause: possibly metric discontinuity.
Advertisement
How it works end to end
Classic examples: CoT reasoning, in-context learning.
Schaeffer argument: smooth improvement + discontinuous metrics.
Reality: mix of both.