Atlas

Benchmarks

← All benchmarks

PolyMath

Math · 2025-04-25

PolyMath is a multilingual mathematical reasoning benchmark of 9,000 problems: 125 problems at each of four difficulty levels, from grade school to Olympiad, translated into 18 languages. Its official headline metric, difficulty-weighted accuracy, weights the four levels 1, 2, 4 and 8 before averaging across languages; release tables that label it simply PolyMath report this same figure. Higher is better.

Top models (higher is better)

ModelScore
Qwen3.7-Max (source unspecified)86.5
Qwen3.7-Plus (source unspecified)84.0
Kimi K2.682.7
Gemini 3 Pro Preview81.6
Opus 4.680.2
Opus 4.579.0
Qwen3.6 Plus (2026-04-02)77.4
Qwen3.5 397B A17B73.3
DeepSeek-V4-Pro72.0
Qwen3.5-27B71.2
Qwen3.5 122B A10B68.9
GLM-5.167.6
GPT-5 Mini67.3
GLM-565.2
Qwen3 Max Thinking (2026-01-23)64.7
Qwen3.5 35B A3B64.4
GPT-5.262.5
Qwen3-235B-A22B60.1
Qwen3 235B A22B Thinking 250760.1
Qwen3 VL 235B A22B Thinking57.8
Qwen3.5-9B57.3
gpt-oss-120b54.0
Qwen3 30B A3B Thinking 250752.6
Gemini 2.5 Pro52.2
Qwen3 VL 32B Thinking52.0
Qwen3 VL 30B A3B Thinking51.7
Qwen3.5-4B51.1
Qwen3 235B A22B Instruct 250750.2
Gemini 2.5 Flash49.8
o349.7
O4 Mini48.7
Qwen3 VL 8B Thinking47.5
Qwen3 32B47.4
Qwen3 Omni 30B A3B Thinking47.1
DeepSeek-R147.1
DeepSeek-R1-052846.9
Qwen3 4B Thinking 250746.2
Qwen3-30B-A3B46.1
Qwen3 Next 80B A3B Instruct45.9
QwQ-32B45.9
Loading Atlas data…