Atlas

Benchmarks

LiveBench 2.0 (2026-11-06) Coding

LiveBench 2.0 (2026-11-06 release) Coding suite: Fix a real bug in a large production codebase frozen at a fixed snapshot; hidden tests grade the fix and a fix that breaks existing behaviour scores 0; 24 tasks. LiveBench 2.0's release of 2026-11-06 (Abacus AI) reruns Long Agentic, Coding, Research and Design on new tasks and keeps the Reasoning and Data Analysis runs and the October 25 Browser runs; each suite is one run per model at its highest supported effort, a task the run could not measure scores 0, and a model without an input a suite needs scores 0 there. A separate family from the 2026-10-14 release, whose Overall weights suites equally.

Models
36
Top score
91.9
Leader
GPT-6.2 Astra
Updated
—
Resolution
—
Saturation
—
Signal
92ndpercentile
141 benchmarks from 0.8 to 2.9196 benchmarks from 2.9 to 5.0131 benchmarks from 5.0 to 7.1105 benchmarks from 7.1 to 9.282 benchmarks from 9.2 to 11.365 benchmarks from 11.3 to 13.327 benchmarks from 13.3 to 15.421 benchmarks from 15.4 to 17.58 benchmarks from 17.5 to 19.68 benchmarks from 19.6 to 21.76 benchmarks from 21.7 to 23.84 benchmarks from 23.8 to 25.95 benchmarks from 25.9 to 28.03 benchmarks from 28.0 to 30.12 benchmarks from 30.1 to 32.14 benchmarks from 32.1 to 34.21 benchmark from 34.2 to 36.33 benchmarks from 36.3 to 38.41 benchmark from 38.4 to 40.52 benchmarks from 40.5 to 42.61 benchmark from 42.6 to 44.71 benchmark from 44.7 to 46.81 benchmark from 48.9 to 50.9

66th strongest of 818

Signal-to-noise +16.23 for the LiveBench 2.0 (2026-11-06 release) family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

Organizations
35 dated models · 5 frontier modelsClosed weightsOpen weights
Data: LiveBenchatlas.village.dev

LiveBench 2.0 (2026-11-06) Coding leaderboard

#ModelSettingScoreSource
1GPT-6.2 Astramax
91.9
2Gemini 4 Carbonhigh
91.0
3Claude Fable 5.1max
89.7
4Gemini 4 Neonx-high
89.7
5GPT-6.1 Terramax
89.2
6GPT-6 Astramax
87.5
7Claude Opus 5.5max
87.1
8Gemini 4 Argonhigh
85.7
9Muse Spark 1.3max
84.4
10GPT-5.6 Terramax
84.2
11GPT-6.2 Solmax
83.7
12GPT-6.1 Solmax
82.1
13DeepSeek V4.1 Flash 1017max
80.4
14Mistral Large 4high
79.4
15Claude Fable 5.2x-high
79.2
16Gemini 4 Hydrogenx-high
78.5
17Claude Haiku 5.5max
77.6
18Claude Sonnet 5.5max
77.2
19Grok 4.6x-high
76.7
20Muse Wondermax
74.9
21Gemini 3.8 Flashhigh
73.3
22Grok 4.7x-high
73.1
23GLM-5.3 Flashmax
70.9
24GPT-6 Lunamax
70.8
25Qwen4-Maxx-high
69.8
26Qwen3.8 27Bx-high
69.3
27MiniMax M3.1 Flashmax
68.8
28Kimi K3.1 Promax
67.8
29Step 5 Previewhigh
67.6
30MiMo-V2.6-Prohigh
64.5
31Muse Spark Openx-high
55.1
32Nemotron 3.5 Super VL 120B A12B BF16thinking
54.1
33Kimi K3max
53.1
34Inklingnot reported
48.7
35Nemotron 3.5 Super VL 120B A12B NVFP4thinking
34.8
36Gemma 4 31B ITmax
20.3

Related benchmarks

Loading Atlas data…