Atlas

Benchmarks

SciResearch-Eval (95% interval coverage, physics-wrong tasks)

How often the 95% intervals agents report in SciResearch-Eval contain the exact true property, pooled over the three properties of the 38 held-out tasks whose simulator is missing physics and over every run, with an unsubmitted run counting as three misses. A calibrated agent scores about 95; far below is confidently wrong, and above 95 is cautious rather than better, since uselessly wide intervals reach 100. The target is therefore 95, and the interval score, not coverage, ranks models. A diagnostic of the interval score.

Models
9
Top score
93.6
Leader
GPT-6 Astra
Updated
Nov 16, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Loading Atlas data…