RLHF Math Deep Dive

Why it matters

RLHF aligned ChatGPT + Claude. Math shapes safety and quality.

The architecture

SFT → reward model → PPO.

KL penalty vs base.

Iterative rounds.

How it works end to end

InstructGPT 2022.

Anthropic RLHF + Constitutional.

KL keeps close.