Atlas

Benchmarks

SPU (scored-run mean, refusals excluded)

The raw mean Spearman score over the public SPU tasks each configuration was scored on, the dataset card's `public100-scored-mean-spearman-v1`. Refusals and unrecoverable runs are dropped, so each configuration has its own denominator (30 to 100 tasks). Diagnostic; the primary `spu-v1-public-100` counts every run.

Models
10
Top score
0.5
Leader
Claude Opus 5.5
Updated
Nov 11, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
10 dated models · 3 frontier modelsClosed weightsOpen weights
Data: UniPat AIatlas.village.dev

SPU (scored-run mean, refusals excluded) leaderboard

Related benchmarks

Loading Atlas data…