Transfer Learning Scaling

Why it matters

Transfer scaling shapes model use. Understanding shapes strategy.

The architecture

Bigger pretrain = better transfer.

PEFT adapts efficiently.

Downstream data + compute smaller than pretrain.

How it works end to end

Empirically larger bases transfer better.

Emergent capabilities at scale enable new transfers.

PEFT captures efficiency.