Why it matters
ORPO simplifies alignment pipeline. Understanding shapes design.
Advertisement
The architecture
SFT loss + odds-ratio term.
No separate reference model.
Alpha tunes weights.
Advertisement
How it works end to end
Alpha 0.1 typical.
PEFT compatible.
Faster than SFT + DPO.