PEFT Theory Overview

Why it matters

PEFT unifies efficient FT methods. Understanding shapes strategy.

The architecture

Freeze base; train small subset (adapters, prefixes, prompts, bias).

Compose approaches.

How it works end to end

Houlsby adapters 2019 original.

PEFT library standard.

Adapter Hub for sharing.

Combine methods possible.