HarmBench

Why it matters

HarmBench is comprehensive attack eval. Understanding shapes red-teaming.

The architecture

510 behaviors (harmful).

Multiple attack methods.

Trained classifier for judgment.

How it works end to end

Mazeika et al. 2024.

Attack methods: GCG, PAIR, AutoDAN, more.

Fine-tuned safety classifier.