Adapters
Inject small MLP after each transformer block. Trained. Older technique; LoRA generally better.
Advertisement
Prompt tuning
Learn continuous 'soft prompt' embedding. Prepend to input. Very few params. Works for large models, weak for small.
Advertisement
Prefix tuning
Extension: prepend to every layer's key/value cache. More parameters than prompt tuning. Middle ground.