Why it matters

ToxiGen tests nuanced toxicity. Understanding shapes fairness eval.

Advertisement

The architecture

Generated toxic + benign statements.

Multiple demographic axes.

Classifier + human labels.

ToxiGen datasetGenerated statementsGPT-3 basedDemographic axesmultiple groupsLabelsclassifier + humanHartvigsen et al. 2022; complements RealToxicityPrompts + BOLD
ToxiGen.
Advertisement

How it works end to end

274k statements.

13 demographic groups.

Human-annotated subset.

Beyond explicit slurs.