Why it matters
Jailbreaks bypass safety. Defense is arms race; layered helps.
Advertisement
The architecture
Safety RLHF training.
Refusal classifier.
Output filter for policy.
Advertisement
How it works end to end
Safety training.
Refusal classifier.
Output policy filter.