Why it matters

OpenAI drives frontier scaling. Understanding shapes ecosystem.

Advertisement

The architecture

Kaplan initial laws.

GPT-3 scaling verification.

GPT-4 technical report scaling.

Reward model scaling.

OpenAI scaling seriesKaplan 2020initial lawsGPT-3, GPT-4verificationReward + o1 scalingpost-trainingOpenAI increasingly opaque on training details; scaling papers cover various aspects
OpenAI scaling.
Advertisement

How it works end to end

Multiple scaling papers.

Post-training scaling (o1).

Reward model scaling.

Predictable scaling for GPT-4.