FrontierPhysics v0.1 Verifier Pass
Science
Share of a configuration's 168 FrontierPhysics v0.1 rollouts (56 physics research tasks, three trials each) whose deliverables pass the task's code verifier, without the further checks of the headline Overall Pass. It comes from the same rollouts as the headline and is a component of its factor group.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Opus 5.5 | 40.5 |
| GPT-6 Astra | 34.5 |
| Gemini 4 Argon | 33.3 |
| GPT-6.1 Sol | 31.0 |
| Claude Fable 5.1 | 28.6 |
| GPT-6 Sol | 21.4 |
| GPT-5.6 Sol | 17.9 |
| Grok 4.7 | 17.9 |
| Claude Opus 5 | 16.7 |
| GPT-5.6 Terra | 14.9 |
| Claude Haiku 5.5 | 14.3 |
| GPT-5.6 Luna | 11.9 |
| MiMo-V2.6-Pro | 9.5 |
| Gemini 3.8 Flash | 7.7 |
| GLM-5.3 | 7.1 |
| Mistral Large 4 Preview | 4.8 |
| Grok 4.6 | 4.2 |
| Kimi K3 | 3.0 |