Why it matters

HELM covers many axes. Understanding shapes broad evaluation.

Advertisement

The architecture

Scenarios × metrics matrix.

Efficiency includes inference speed.

Public leaderboards.

HELM benchmarkScenariosdiverseMetricsmulti-axisLeaderboardspublic trackingcrfm.stanford.edu/helm; open-source runners; complements Arena + capability benchmarks
HELM.
Advertisement

How it works end to end

crfm.stanford.edu/helm.

Multiple HELM suites (Instruct, Safety, Capabilities).

Open-source runner.