JailbreakBench

Why it matters

JailbreakBench standardizes jailbreak eval. Understanding shapes attack eval.

The architecture

100 harmful + 100 benign behaviors.

Attack artifacts library.

Judge model for success.

How it works end to end

Reproducible attack artifacts.

Judge model standardized.

Benign behaviors test over-refusal.