Atlas

Benchmarks

← All benchmarks

CMIMC 2025

Math · 2025-05-29

This MathArena track evaluates models on the CMIMC 2025 problem set. Published scores average correctness across observed problem attempts; the item count records distinct problems, not a single-run binomial denominator.

Top models (higher is better)

ModelScore
DeepSeek-V3.2-Speciale95.6
GPT-5.295.6
Step 3.5 Flash95.6
GPT-5.194.4
GLM-593.1
Kimi K2.590.6
Kimi K2 Thinking90.6
Gemini 3 Flash Preview90.0
Gemini 3 Pro Preview90.0
GPT-588.8
GLM 4.687.5
gpt-oss-120b85.0
Grok 485.0
Grok 4 Fast85.0
DeepSeek-V3.284.4
GPT-5 Mini84.4
Grok 4.1 Fast84.4
O4 Mini83.8
DeepSeek-V3.182.5
o382.5
DeepSeek-V3.2-Exp76.3
GPT-5 Nano74.4
gpt-oss-20b73.8
GLM-4.572.5
Falcon H1R 7B71.9
GLM 4.5 Air71.9
DeepSeek-R1-052871.3
Grok 3 Mini68.1
K2-Think68.1
Sonnet 4.566.3
QED-Nano61.9
Gemini 2.5 Pro58.1
Gemini 2.5 Flash54.4
Loading Atlas data…