Human ranking
Show 2-4 responses per prompt. Annotator picks best. Pairs derived. Slow + expensive but high quality.
Advertisement
LLM as judge
GPT-4/Claude judges quality. Faster + cheaper. Biases (position, length). Cross-check with human sample.
Advertisement
Self-rewarding
Model judges own outputs. Iterative improvement. Yuan et al 2024.