Per-case comparison
Score every case before + after. Diff shows which regressed.
Advertisement
Statistical significance
N = 500 cases. If pass rate drops by 3%, is that noise? Use bootstrap CI to know.
Advertisement
Regressions per tag
Sometimes overall pass rate is unchanged but one tag regressed hard. Slice reports catch this.