Neural Scaling Law Theory

Why it matters

Scaling theory unifies empirics. Understanding shapes design intuition.

The architecture

Data + model + noise interact.

Random feature model analysis.

Kernel regime + feature learning.

How it works end to end

Random feature regime.

Data manifold dimension.

Noise floor from data.

Feature learning corrections.