DeepMind Scaling Law Series

Why it matters

DeepMind is central scaling contributor. Understanding shapes ecosystem.

The architecture

Gopher: 280B baseline.

Chinchilla: revised laws.

RETRO: retrieval-augmented scaling.

Data quality studies.

How it works end to end

Extensive published scaling work.

Multiple model families.

Data quality + curation research.