Why it matters

GAIA tests general assistant capability. Understanding shapes eval design.

Advertisement

The architecture

3 levels of difficulty.

Requires tools (browsing, code).

Human 92% baseline.

GAIA levelsQuestionhuman-solvableAgent + toolsbrowse + codeAnswercompared to goldLevel 3 requires many steps + multimodal; benchmark for assistant quality
GAIA.
Advertisement

How it works end to end

Level 1: fewer steps.

Level 2-3: complex reasoning + browsing.

Tool use essential.

Public + hidden test sets.