Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresLiveBench 2.0 (2026-11-06 release) Design suite: Produce or rework a finished document to a brief: Word documents, PDFs and slide decks; 25 tasks. LiveBench 2.0's release of 2026-11-06 (Abacus AI) reruns Long Agentic, Coding, Research and Design on new tasks and keeps the Reasoning and Data Analysis runs and the October 25 Browser runs; each suite is one run per model at its highest supported effort, a task the run could not measure scores 0, and a model without an input a suite needs scores 0 there. A separate family from the 2026-10-14 release, whose Overall weights suites equally.
66th strongest of 818 fitted benchmarks
Signal-to-noise +16.23 for the LiveBench 2.0 (2026-11-06 release) family
Another benchmark represents this family in the fit.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Claude Fable 5.2 | x-high | 85.1 | |
| 2 | Claude Opus 5.5 | max | 83.3 | |
| 3 | GPT-6.2 Astra | max | 82.8 | |
| 4 | Claude Fable 5.1 | max | 81.6 | |
| 5 | Gemini 4 Neon | x-high | 81.5 | |
| 6 | Claude Sonnet 5.5 | max | 81.3 | |
| 7 | Gemini 4 Carbon | high | 80.2 | |
| 8 | GPT-6 Astra | max | 80.0 | |
| 9 | GPT-6.2 Sol | max | 80.0 | |
| 10 | DeepSeek V4.1 Flash 1017 | max | 79.8 | |
| 11 | GPT-6.1 Terra | max | 79.7 | |
| 12 | GPT-6.1 Sol | max | 79.6 | |
| 13 | Claude Haiku 5.5 | max | 79.3 | |
| 14 | Qwen4-Max | x-high | 79.1 | |
| 15 | Gemini 4 Hydrogen | x-high | 77.3 | |
| 16 | Grok 4.6 | x-high | 76.3 | |
| 17 | Mistral Large 4 | high | 76.3 | |
| 18 | GPT-6 Luna | max | 76.1 | |
| 19 | Grok 4.7 | x-high | 75.0 | |
| 20 | Muse Spark 1.3 | max | 74.8 | |
| 21 | MiMo-V2.6-Pro | high | 74.3 | |
| 22 | GLM-5.3 Flash | max | 73.7 | |
| 23 | Kimi K3.1 Pro | max | 73.7 | |
| 24 | Kimi K3 | max | 72.5 | |
| 25 | Qwen3.8 27B | x-high | 72.4 | |
| 26 | MiniMax M3.1 Flash | max | 71.2 | |
| 27 | GPT-5.6 Terra | max | 70.9 | |
| 28 | Muse Wonder | max | 70.9 | |
| 29 | Step 5 Preview | high | 70.8 | |
| 30 | Gemini 3.8 Flash | high | 69.7 | |
| 31 | Gemini 4 Argon | high | 69.2 | |
| 32 | Nemotron 3.5 Super VL 120B A12B BF16 | thinking | 60.0 | |
| 33 | Muse Spark Open | x-high | 58.1 | |
| 34 | Gemma 4 31B IT | max | 56.5 | |
| 35 | Nemotron 3.5 Super VL 120B A12B NVFP4 | thinking | 55.6 | |
| 36 | Inkling | not reported | 55.2 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).