Why it matters

Toxicity has specific patterns. Understanding shapes moderation.

Advertisement

The architecture

Perspective API: Google. Toxicity score 0-1.

Detoxify: open-source alternative.

Toxicity detection optionsPerspective APIGoogle managedDetoxifyopen-sourceCustom fine-tunedomain-specificPerspective has multiple sub-categories (severe toxicity, insult, threat)
Toxicity options.
Advertisement

How it works end to end

Sub-categories: severe toxicity, insult, threat, sexual.

Detoxify: BERT-based, self-hostable.

Language: many languages supported.

Threshold: score above threshold triggers action.