Why it matters

RealToxicity is baseline toxicity benchmark. Understanding shapes eval.

Advertisement

The architecture

Provide prompt to LLM.

Sample continuation.

Score continuation with Perspective API or classifier.

RealToxicity flowPromptfrom RealToxicitySample continuationfrom LLMScore toxicityPerspective APIPerspective API scoring standard; combine with LlamaGuard for coverage
RealToxicity.
Advertisement

How it works end to end

100k prompts.

Toxicity probability per prompt.

Perspective API for scoring.