Benchmarks
357 sources · 1,263 models × 3,079 benchmarks · 162,127 scoresLiveBench 2.0 (2026-11-06 release) Reasoning suite: Single-answer reasoning questions (theory of mind, zebra puzzles, spatial, logic with navigation); 202 questions. LiveBench 2.0's release of 2026-11-06 (Abacus AI) reruns Long Agentic, Coding, Research and Design on new tasks and keeps the Reasoning and Data Analysis runs and the October 25 Browser runs; each suite is one run per model at its highest supported effort, a task the run could not measure scores 0, and a model without an input a suite needs scores 0 there. A separate family from the 2026-10-14 release, whose Overall weights suites equally.
66th strongest of 818 fitted benchmarks
Signal-to-noise +16.23 for the LiveBench 2.0 (2026-11-06 release) family
Another benchmark represents this family in the fit.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 4 Argon | high | 95.1 | |
| 2 | GPT-6 Astra | max | 92.7 | |
| 3 | GPT-6.1 Sol | max | 92.6 | |
| 4 | Claude Opus 5.5 | max | 92.2 | |
| 5 | Qwen4-Max | x-high | 92.2 | |
| 6 | Claude Fable 5.1 | max | 91.7 | |
| 7 | Claude Sonnet 5.5 | max | 91.6 | |
| 8 | GPT-6.2 Astra | max | 91.6 | |
| 9 | Grok 4.6 | x-high | 91.2 | |
| 10 | Kimi K3.1 Pro | max | 91.1 | |
| 11 | Kimi K3 | max | 90.7 | |
| 12 | Gemini 4 Carbon | high | 90.6 | |
| 13 | GPT-5.6 Terra | max | 90.6 | |
| 14 | GPT-6.2 Sol | max | 90.6 | |
| 15 | Muse Wonder | max | 90.6 | |
| 16 | Muse Spark 1.3 | max | 89.7 | |
| 17 | Gemini 4 Neon | x-high | 89.6 | |
| 18 | Gemini 3.8 Flash | high | 89.3 | |
| 19 | DeepSeek V4.1 Flash 1017 | max | 89.1 | |
| 20 | Claude Fable 5.2 | x-high | 88.8 | |
| 21 | GPT-6.1 Terra | max | 88.7 | |
| 22 | Gemini 4 Hydrogen | x-high | 88.6 | |
| 23 | Mistral Large 4 | high | 85.2 | |
| 24 | Step 5 Preview | high | 83.8 | |
| 25 | MiniMax M3.1 Flash | max | 82.9 | |
| 26 | Grok 4.7 | x-high | 82.7 | |
| 27 | Claude Haiku 5.5 | max | 82.4 | |
| 28 | GPT-6 Luna | max | 81.8 | |
| 29 | Qwen3.8 27B | x-high | 80.0 | |
| 30 | MiMo-V2.6-Pro | high | 79.6 | |
| 31 | Inkling | not reported | 78.3 | |
| 32 | GLM-5.3 Flash | max | 77.6 | |
| 33 | Nemotron 3.5 Super VL 120B A12B BF16 | thinking | 74.6 | |
| 34 | Muse Spark Open | x-high | 73.7 | |
| 35 | Nemotron 3.5 Super VL 120B A12B NVFP4 | thinking | 71.7 | |
| 36 | Gemma 4 31B IT | max | 68.3 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).