LiveCodeBench - August 2024 to May 2025
Code
LiveCodeBench code-generation problems in the August 1, 2024 to May 1, 2025 date window (the v6 cohort), labelled 2408-2505 in DeepSeek's R1-0528, V3.1 and V3.2-Exp cards, 2024.08-2025.04 in its V3.2 report, and "Aug 24 - May 25" in Moonshot's Kimi K2 report and NVIDIA's Nemotron cards. This exact historical problem cohort is retained as a diagnostic rather than pooled with other LiveCodeBench windows.
Top models (higher is better)
| Model | Score |
|---|---|
| DeepSeek-V4-Flash-0731 | 94.6 |
| Qwen3.8-Flash-Next | 94.1 |
| Gemini 3 Pro Preview | 90.7 |
| Nemotron 3 Ultra 550B A55B | 89.2 |
| DeepSeek-V3.2-Speciale | 88.7 |
| Nemotron Cascade 2 30B A3B | 88.4 |
| Inkling-Small | 88.3 |
| Nemotron 3.5 Super VL 120B A12B BF16 | 88.2 |
| Nemotron 3.5 Super VL 120B A12B NVFP4 | 87.4 |
| GPT-5 | 84.5 |
| DeepSeek-V3.2 | 83.3 |
| MiniMax M2 | 83.0 |
| Kimi K2 Thinking | 82.6 |
| GLM-5.3 Flash | 80.6 |
| o3 | 77.3 |
| Qwen3.5 122B A10B | 76.7 |
| DeepSeek-V3.1-Terminus | 74.9 |
| DeepSeek-V3.1 | 74.8 |
| Nemotron Cascade 14B Thinking | 74.6 |
| DeepSeek-V3.2-Exp | 74.1 |
| DeepSeek-R1-0528 | 73.3 |
| Gemini 2.5 Pro Preview 05-06 | 71.8 |
| Nemotron Cascade 8B Thinking | 71.4 |
| Nemotron Cascade 8B | 71.1 |
| Qwen3-235B-A22B | 66.5 |
| o3-mini | 65.9 |
| Nemotron Nano 9B V2 | 65.3 |
| Sonnet 4.5 | 64.0 |
| DeepSeek-R1 | 63.5 |
| Qwen3 14B | 63.5 |
| Gemini 2.5 Flash | 62.3 |
| DeepSeek R1 0528 Qwen3 8B | 60.5 |
| Qwen3 8B | 58.3 |
| Kimi K2 Instruct | 53.7 |
| Sonnet 4 | 48.5 |
| Opus 4 | 47.4 |
| GPT-4.1 | 44.7 |