Atlas

Benchmarks

← All benchmarks

LiveCodeBench - February to May 2025

Code

LiveCodeBench code-generation problems released between February 1 and May 1, 2025, the window Qwen labels "LiveCodeBench v6 (25.02-25.05)". This exact historical problem cohort is retained as a diagnostic rather than pooled with other LiveCodeBench windows.

Top models (higher is better)

ModelScore
Qwen3 235B A22B Thinking 250774.1
Gemini 2.5 Pro72.5
O4 Mini71.8
Qwen3 VL 235B A22B Thinking70.1
Qwen3-Max (2025-09-23)69.0
DeepSeek-R1-052868.7
Qwen3-Next-80B-A3B-Thinking68.7
Qwen3 30B A3B Thinking 250766.0
Qwen3 VL 32B Thinking65.6
Qwen3 VL 30B A3B Thinking64.2
Gemini 2.5 Flash61.2
Qwen3 32B60.6
o358.6
Qwen3 VL 8B Thinking58.6
Qwen3-30B-A3B57.4
Qwen3 Next 80B A3B Instruct56.6
Qwen3-235B-A22B55.7
Qwen3 4B Thinking 250755.2
Qwen3-VL-235B-A22B-Instruct54.3
DeepSeek-V3.152.3
Qwen3 235B A22B Instruct 250751.8
Qwen3 VL 4B Thinking51.3
Qwen3 8B51.0
Opus 448.9
Kimi K2 Instruct48.9
Qwen3 4B48.4
DeepSeek-V3-032445.2
Qwen3 VL 32B Instruct43.8
Qwen3 30B A3B Instruct 250743.2
Qwen3 VL 30B A3B Instruct42.6
Qwen3-VL-8B-Instruct39.3
Qwen3 VL 4B Instruct37.9
ChatGPT-4o Latest observed 2025-03-2735.8
Qwen3 4B Instruct 250735.1
GPT-4.1 Nano31.5
Qwen3 1.7B31.3
Qwen3 VL 2B Thinking29.3
Qwen3 VL 2B Instruct20.3
Loading Atlas data…