Why it matters

Behavior diff shapes iteration. Understanding shapes evaluation.

Advertisement

The architecture

Run same tasks on old + new.

Diff outputs + trajectories.

Aggregate + example view.

Agent behavior diffSame tasksconsistent inputOld + new agentrun bothDiff output + tracesexample + aggregateLLM-as-judge for semantic diff; exact match for structured outputs
Agent diff.
Advertisement

How it works end to end

Semantic diff via LLM judge.

Structured output exact-match.

Trajectory step-by-step comparison.