Why it matters
QLoRA changed FT economics. Understanding shapes strategy.
Advertisement
The architecture
Load base in NF4 4-bit.
Train LoRA in bf16.
Paged optimizers for OOM protection.
Advertisement
How it works end to end
Dettmers 2023.
NF4 quantization.
Double quantization.
Paged AdamW.