Signal Propagation in Deep Networks

Why it matters

Signal propagation theory shapes design. Understanding shapes stability.

The architecture

Compute activation + gradient variances at each layer.

Detect explosion / collapse.

How it works end to end

Meanfield analysis.

Isometric layers.

Deep linear networks as toy.

Guides init + norm choices.