Why it matters

Lottery ticket hypothesis grounds pruning research. Sparse nets can match dense.

Advertisement

The architecture

Dense random init.

Sparse subnet exists.

Train subnet to full accuracy.

Lottery ticket hypothesisDense initrandom weightsSparse subnetexistsTrain subnetmatches denseFrankle-Carbin 2019; basis for structured pruning research
Lottery ticket hypothesis.
Advertisement

How it works end to end

Frankle-Carbin 2019.

Structured pruning.

Sparse training active.