Why it matters
Variance maintenance shapes stability. Understanding shapes design.
Advertisement
The architecture
Init preserves fan-in variance.
Norm resets.
Residual doesn't accumulate.
Advertisement
How it works end to end
Signal Propagation Theory (SPT).
Isometric init.
Norm placement.
Residual scaling.