Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresSurge AI's DAYJOB: Law as Surge published it on November 18, 2026: 71 legal assignments written by practicing lawyers, with 2,638 workspace files, run in Surge's DAYJOB Harbor harness with browsing and package downloads blocked. An attempt passes when it meets at least 95% of the task's rubric criteria and the board reports pass@1; the dataset card's configuration for published results uses five attempts per task, and 22 of the 24 values fit 355 attempts. Before release Surge supplied early results to Fireworks' Specialized Intelligence Index, kept as DAYJOB: Law. All 15 models on both boards score lower here, by 0.2 to 16.0 points (Muse Wonder 1.0 Max, 36.6 to 20.6), Grok 4.7 is gone and neither publisher explains the change, so the two scales are kept apart.
173rd strongest of 818 fitted benchmarks
Signal-to-noise +10.96
56th hardest of 818 fitted benchmarks
Capability needed ≳ 177.2
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | GPT-6.2 Astra | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 41.4 | |
| 2 | GPT-6 Astra | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 36.6 | |
| 3 | GPT-6.2 Sol | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 32.7 | |
| 4 | GPT-6.1 Sol | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 31.6 | |
| 5 | Claude Sonnet 5.5 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 26.8 | |
| 6 | Claude Fable 5.2 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 26.5 | |
| 7 | Gemini 4 Neon | high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 26.2 | |
| 8 | Claude Opus 5.5 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 23.7 | |
| 9 | Claude Fable 5.1 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 22.5 | |
| 10 | Kimi K3.1 Pro | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 22.0 | |
| 11 | Muse Wonder | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 20.6 | |
| 12 | Qwen4-Max | x-high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 17.5 | |
| 13 | Gemini 4 Carbon | high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 13.8 | |
| 14 | Muse Spark 1.3 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 11.8 | |
| 15 | Gemini 4 Hydrogen | x-high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 9.7 | |
| 16 | Gemini 4 Argon | high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 5.9 | |
| 17 | GLM-5.3 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 3.7 | |
| 18 | DeepSeek V4.1 Flash 1017 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 2.8 | |
| 19 | Inkling 2 Small | 0.99 · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads; temperature 1.0; 1M-token trajectory limit | 1.7 | |
| 20 | Kimi K3 | max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 1.7 | |
| 21 | Gemini 3.8 Flash | high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads | 0.0 | |
| 22 | Inkling | not reported · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads; source requests max, whose native provider interpretation is unreported | 0.0 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).