Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresLiveBench 2.0 (2026-11-06 release) Long Agentic suite: Long-running agentic work where early decisions must hold up through later turns, simulated months or test cases (finance and operations apps, long-run operations, systems engineering, performance optimisation); 18 tasks, each scored 0-100. LiveBench 2.0's release of 2026-11-06 (Abacus AI) reruns Long Agentic, Coding, Research and Design on new tasks and keeps the Reasoning and Data Analysis runs and the October 25 Browser runs; each suite is one run per model at its highest supported effort, a task the run could not measure scores 0, and a model without an input a suite needs scores 0 there. A separate family from the 2026-10-14 release, whose Overall weights suites equally.
66th strongest of 818 fitted benchmarks
Signal-to-noise +16.23 for the LiveBench 2.0 (2026-11-06 release) family
Another benchmark represents this family in the fit.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Claude Fable 5.2 | x-high | 82.9 | |
| 2 | Gemini 4 Neon | x-high | 82.6 | |
| 3 | GPT-6 Astra | max | 74.7 | |
| 4 | Claude Fable 5.1 | max | 74.2 | |
| 5 | Claude Opus 5.5 | max | 72.8 | |
| 6 | Gemini 4 Carbon | high | 71.8 | |
| 7 | GPT-6.2 Astra | max | 70.8 | |
| 8 | GPT-6.1 Sol | max | 64.7 | |
| 9 | GPT-6.2 Sol | max | 63.6 | |
| 10 | Claude Sonnet 5.5 | max | 62.5 | |
| 11 | Gemini 4 Hydrogen | x-high | 61.8 | |
| 12 | Gemini 4 Argon | high | 58.5 | |
| 13 | GPT-6.1 Terra | max | 55.3 | |
| 14 | Claude Haiku 5.5 | max | 47.9 | |
| 15 | Muse Spark 1.3 | max | 47.9 | |
| 16 | Qwen4-Max | x-high | 46.6 | |
| 17 | Muse Wonder | max | 46.2 | |
| 18 | Grok 4.7 | x-high | 45.3 | |
| 19 | DeepSeek V4.1 Flash 1017 | max | 38.8 | |
| 20 | Kimi K3.1 Pro | max | 38.7 | |
| 21 | MiMo-V2.6-Pro | high | 36.4 | |
| 22 | Kimi K3 | max | 36.0 | |
| 23 | GPT-5.6 Terra | max | 25.9 | |
| 24 | MiniMax M3.1 Flash | max | 25.7 | |
| 25 | GPT-6 Luna | max | 24.7 | |
| 26 | Mistral Large 4 | high | 24.7 | |
| 27 | GLM-5.3 Flash | max | 20.7 | |
| 28 | Step 5 Preview | high | 19.4 | |
| 29 | Grok 4.6 | x-high | 18.7 | |
| 30 | Gemini 3.8 Flash | high | 16.5 | |
| 31 | Qwen3.8 27B | x-high | 15.9 | |
| 32 | Muse Spark Open | x-high | 12.1 | |
| 33 | Nemotron 3.5 Super VL 120B A12B BF16 | thinking | 12.0 | |
| 34 | Nemotron 3.5 Super VL 120B A12B NVFP4 | thinking | 11.0 | |
| 35 | Inkling | not reported | 9.8 | |
| 36 | Gemma 4 31B IT | max | 8.5 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).