Lottery Ticket Hypothesis

Why it matters

LTH illuminates network capacity + pruning. Understanding shapes sparsity research.

The architecture

Train dense.

Prune small weights.

Reset remaining to init.

Retrain: matches dense.

How it works end to end

Iterative magnitude pruning.

Rewind to early training weights (not init).

Applications to LLM debated.