← All benchmarks
FrontierChallenge (Pass Rate, Medium tasks)
Science · 2026-08-25
The share of FrontierChallenge's 23 Medium scientific-workflow tasks that a configuration fully completes, in percent, from the same single run per task as the 97-task Pass Rate and under the same historical rule (a native score of at least 99.9 out of 100, not recomputed under the September 23, 2026 policy of a completed task_score above 0.999). With the 74 Hard tasks it makes up the overall Pass Rate.
Benchmark source: arXiv
Top models (higher is better)
| Model | Score | Source |
|---|
| Grok 4.6 | 43.5 | FrontierChallenge paper Table 2 (Grok 4.6 / Claude Code, Medium) · Apodex |
| Claude Opus 5 | 39.1 | FrontierChallenge paper Table 2 (Claude Opus 5 / Claude Code, Medium) · Apodex |
| GPT-5.6 Sol | 39.1 | FrontierChallenge paper Table 2 (GPT-5.6 Sol / Codex, Medium) · Apodex |
| GPT-5.6 Terra | 39.1 | FrontierChallenge paper Table 2 (GPT-5.6 Terra (max) / Codex, Medium) · Apodex |
| Kimi K3 | 39.1 | FrontierChallenge paper Table 2 (Kimi K3 / Claude Code, Medium) · Apodex |
| DeepSeek-V4-Flash-0731 | 34.8 | FrontierChallenge paper Table 2 (DeepSeek V4 Flash-0731 / Claude Code, Medium) · Apodex |
| Qwen3.8-Max | 34.8 | FrontierChallenge paper Table 2 (Qwen 3.8 Max / Claude Code, Medium) · Apodex |
| Apodex 1.1 | 30.4 | FrontierChallenge paper Table 2 (Apodex 1.1 / Claude Code, Medium) · Apodex |
| DeepSeek V4 Pro 0813 | 30.4 | FrontierChallenge paper Table 2 (DeepSeek V4 Pro-0813 / Claude Code, Medium) · Apodex |
| Gemini 3.7 Flash | 21.7 | FrontierChallenge paper Table 2 (Gemini 3.7 Flash / Claude Code, Medium) · Apodex |
| Qwen3.5 397B A17B | 13.0 | FrontierChallenge paper Table 2 (Qwen3.5-397B-A17B / Claude Code, Medium) · Apodex |
| GLM-5.2 | 4.3 | FrontierChallenge paper Table 2 (GLM-5.2 / Claude Code, Medium) · Apodex |