Atlas

Benchmarks

← All benchmarks

FrontierPhysics v0.1 Score

Science

FrontierPhysics v0.1 partial-credit score: each rollout that passes under the Overall Pass rule scores its weighted expert-rubric score (0-100) and every other rollout scores 0. The score is averaged over a configuration's 168 rollouts (56 tasks, three trials each). It comes from the same rollouts as the headline and is a component of its factor group.

Top models (higher is better)

ModelScore
Claude Opus 5.521.3
GPT-6 Astra16.7
GPT-6.1 Sol15.3
Claude Fable 5.112.0
GPT-6 Sol10.0
Claude Opus 59.5
GPT-5.6 Sol7.4
Gemini 4 Argon6.5
Grok 4.76.0
Claude Haiku 5.53.5
GPT-5.6 Luna2.9
Grok 4.62.6
GPT-5.6 Terra2.5
GLM-5.31.1
MiMo-V2.6-Pro1.0
Mistral Large 4 Preview0.5
Kimi K30.4
Gemini 3.8 Flash0.0
Loading Atlas data…