Why it matters

Data quality shifts scaling curves. Curation beats raw scale.

Advertisement

The architecture

Quality tokens > count tokens.

Curation + dedupe + filter.

Domain balance.

Data quality mathQuality tokens> raw countCuratededupe, filterDomain balancecode, math, textPhi-3, FineWeb-Edu show quality beats quantity at same compute
Data quality math.
Advertisement

How it works end to end

Phi-3 quality data.

FineWeb-Edu curated.

Dedupe + filter.