Adapter Theory

Why it matters

Adapters are original PEFT. Understanding shapes history.

The architecture

Adapter: down-projection + activation + up-projection.

Residual connection.

Inserted per block.

How it works end to end

Houlsby et al. 2019.

Bottleneck rank r << d.

Adapter Hub for sharing.

Serial + parallel variants.