Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresHuman rubric evaluation of six native agent systems on seven tasks in four categories, from Epoch's November 17, 2026 report. That report replaced the October 8 task suite (six tasks and the data-explorer category removed; Token prices, Chess variants and Hidden messages added), reworked the prompts and moved grading to a 1-4 scale per criterion, so it is kept apart from the October release. A task scores its rubric points over the 4-point maximum, weighted by section, so the lowest possible score is 25; a category weights its easy, average and difficult tasks 2:3:2; the overall is the unweighted mean of the four category scores. Highest available reasoning was selected, but exact native effort values were not disclosed; memory and skill writing were disabled.
No signal or difficulty estimate. Too few models have been measured on this benchmark to estimate its difficulty.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Claude Fable 5.2 | thinking · Epoch Automation Reports: Claude Code; highest available reasoning setting (native value unreported); memory and skill writing disabled | 81.7 | |
| 2 | Claude Opus 5.5 | thinking · Epoch Automation Reports: Claude Code; highest available reasoning setting (native value unreported); memory and skill writing disabled | 77.8 | |
| 3 | Gemini 4 Argon | thinking · Epoch Automation Reports: Antigravity; highest available reasoning setting (native value unreported); memory and skill writing disabled | 67.2 | |
| 4 | GPT-6.2 Astra | thinking · Epoch Automation Reports: Codex; highest available reasoning setting (native value unreported); memory and skill writing disabled | 64.9 | |
| 5 | Claude Fable 5.1 | thinking · Epoch Automation Reports: Claude Code; highest available reasoning setting (native value unreported); memory and skill writing disabled | 64.4 | |
| 6 | GPT-6 Astra | thinking · Epoch Automation Reports: Codex; highest available reasoning setting (native value unreported); memory and skill writing disabled | 55.5 |