Atlas

Benchmarks

DAYJOB: Law (November 2026 release)

Surge AI's DAYJOB: Law as Surge published it on November 18, 2026: 71 legal assignments written by practicing lawyers, with 2,638 workspace files, run in Surge's DAYJOB Harbor harness with browsing and package downloads blocked. An attempt passes when it meets at least 95% of the task's rubric criteria and the board reports pass@1; the dataset card's configuration for published results uses five attempts per task, and 22 of the 24 values fit 355 attempts. Before release Surge supplied early results to Fireworks' Specialized Intelligence Index, kept as DAYJOB: Law. All 15 models on both boards score lower here, by 0.2 to 16.0 points (Muse Wonder 1.0 Max, 36.6 to 20.6), Grok 4.7 is gone and neither publisher explains the change, so the two scales are kept apart.

Models
22
Top score
41.4
Leader
GPT-6.2 Astra
Updated
—
Resolution
~2 mo
Sharp
Saturation
~Jan 2028
Projected
Signal
79thpercentile
141 benchmarks from 0.8 to 2.9196 benchmarks from 2.9 to 5.0131 benchmarks from 5.0 to 7.1105 benchmarks from 7.1 to 9.282 benchmarks from 9.2 to 11.365 benchmarks from 11.3 to 13.327 benchmarks from 13.3 to 15.421 benchmarks from 15.4 to 17.58 benchmarks from 17.5 to 19.68 benchmarks from 19.6 to 21.76 benchmarks from 21.7 to 23.84 benchmarks from 23.8 to 25.95 benchmarks from 25.9 to 28.03 benchmarks from 28.0 to 30.12 benchmarks from 30.1 to 32.14 benchmarks from 32.1 to 34.21 benchmark from 34.2 to 36.33 benchmarks from 36.3 to 38.41 benchmark from 38.4 to 40.52 benchmarks from 40.5 to 42.61 benchmark from 42.6 to 44.71 benchmark from 44.7 to 46.81 benchmark from 48.9 to 50.9

173rd strongest of 818

Signal-to-noise +10.96

Difficulty
93rdpercentile
1 benchmark from 5.8 to 14.71 benchmark from 23.5 to 32.42 benchmarks from 32.4 to 41.21 benchmark from 41.2 to 50.12 benchmarks from 50.1 to 58.99 benchmarks from 58.9 to 67.88 benchmarks from 67.8 to 76.718 benchmarks from 76.7 to 85.523 benchmarks from 85.5 to 94.441 benchmarks from 94.4 to 103.232 benchmarks from 103.2 to 112.141 benchmarks from 112.1 to 121.049 benchmarks from 121.0 to 129.875 benchmarks from 129.8 to 138.760 benchmarks from 138.7 to 147.5122 benchmarks from 147.5 to 156.4135 benchmarks from 156.4 to 165.3124 benchmarks from 165.3 to 174.139 benchmarks from 174.1 to 183.021 benchmarks from 183.0 to 191.88 benchmarks from 191.8 to 200.72 benchmarks from 200.7 to 209.54 benchmarks from 209.5 to 218.4

56th hardest of 818

Capability needed ≳ 177.2

Organizations
22 dated models · 6 frontier modelsClosed weightsOpen weights
Data: Surge AIatlas.village.dev

DAYJOB: Law (November 2026 release) leaderboard

#ModelSettingScoreSource
1GPT-6.2 Astramax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
41.4
2GPT-6 Astramax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
36.6
3GPT-6.2 Solmax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
32.7
4GPT-6.1 Solmax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
31.6
5Claude Sonnet 5.5max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
26.8
6Claude Fable 5.2max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
26.5
7Gemini 4 Neonhigh · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
26.2
8Claude Opus 5.5max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
23.7
9Claude Fable 5.1max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
22.5
10Kimi K3.1 Promax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
22.0
11Muse Wondermax · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
20.6
12Qwen4-Maxx-high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
17.5
13Gemini 4 Carbonhigh · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
13.8
14Muse Spark 1.3max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
11.8
15Gemini 4 Hydrogenx-high · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
9.7
16Gemini 4 Argonhigh · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
5.9
17GLM-5.3max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
3.7
18DeepSeek V4.1 Flash 1017max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
2.8
19Inkling 2 Small0.99 · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads; temperature 1.0; 1M-token trajectory limit
1.7
20Kimi K3max · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
1.7
21Gemini 3.8 Flashhigh · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads
0.0
22Inklingnot reported · Surge DAYJOB OpenHands SDK harness in Harbor; no browsing or package downloads; source requests max, whose native provider interpretation is unreported
0.0

Related benchmarks

Loading Atlas data…