Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresLawrence Livermore National Laboratory's SciResearch-Eval tests scientific judgment on one laboratory problem: an agent measures a plate's thermal conductivity, heat capacity and rear heat-loss coefficient by designing up to four heating experiments and fitting a supplied heat-conduction simulator, within 60 tool calls, and reports each property with a 95% interval. Hidden from the agent, the simulator may be numerically under-resolved or missing real physics (a glued joint, radiation, heat lost through the sides, or temperature-dependent conductivity), and the truth is exact because the real sample is itself simulated with richer physics. The headline score, which ranks models, is the proper interval score of Gneiting and Raftery on a log10 scale (the interval's width plus 40 times any miss), averaged over the three properties and taken as a geometric mean over the 38 held-out tasks whose simulator is missing physics. Lower is better: about 0.01 is excellent and above 1 is confidently wrong. No language-model judge scores it.
No signal or difficulty estimate. This benchmark has no declared score range, so it cannot be placed on the 0-1 scale the capability curve requires.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | GPT-6 Astra | max | 0.0 | |
| 2 | Claude Fable 5.2 | not reported | 0.0 | |
| 3 | Claude Opus 5.5 | x-high | 0.0 | |
| 4 | Claude Sonnet 5.5 | max | 0.1 | |
| 5 | Claude Haiku 5.5 | max | 0.1 | |
| 6 | Sonnet 4.5 | 32k | 1.3 | |
| 7 | Qwen3.8 27B | thinking | 1.4 | |
| 8 | Muse Glimmer 30B | x-high | 1.7 | |
| 9 | Gemma 4 31B IT | disabled | 2.1 |