Training Data Filtering

Why it matters

Data filtering shifts scaling curves. Curation beats raw scale.

The architecture

Language + quality + PII + toxicity filters.

Classifier-based.

Iterate.

How it works end to end

FineWeb-Edu classifier.

Perplexity filter.

Toxicity filter.