Atlas

Benchmarks

← All benchmarks

HMMT February 2025

Math · 2025-02-15

The 30 problems of the February 2025 Harvard-MIT Mathematics Tournament, scored by final-answer correctness as run by a model developer with its own sampling, usually averaging several samples per problem. Shares a factor group with the MathArena track on the same problem set.

Top models (higher is better)

ModelScore
GPT-5.299.4
Qwen3 Max Thinking (2026-01-23)98.0
Gemini 3 Pro Preview97.5
DeepSeek-V3.292.5
Qwen3 235B A22B Thinking 250783.9
Gemini 2.5 Pro82.5
DeepSeek-R1-052879.4
o377.5
Qwen3 VL 235B A22B Thinking77.4
Qwen3-Next-80B-A3B-Thinking73.9
Qwen3 30B A3B Thinking 250771.4
Qwen3-Coder-Next70.2
Qwen3 VL 30B A3B Thinking67.6
O4 Mini66.7
Qwen3 VL 32B Thinking64.6
Gemini 2.5 Flash64.2
Qwen3-235B-A22B62.5
Qwen3 VL 8B Thinking60.6
Opus 458.3
Qwen3-VL-235B-A22B-Instruct57.4
Qwen3 4B Thinking 250755.5
Qwen3 235B A22B Instruct 250755.4
Qwen3 Next 80B A3B Instruct54.1
Qwen3 VL 4B Thinking53.1
Qwen3 VL 30B A3B Instruct50.6
Qwen3-30B-A3B49.8
Qwen3 VL 32B Instruct46.1
Qwen3 8B43.2
Qwen3 30B A3B Instruct 250743.0
Qwen3 4B42.1
Kimi K2 Instruct38.8
Qwen3-VL-8B-Instruct32.5
Qwen3 4B Instruct 250731.0
Qwen3 VL 4B Instruct30.7
DeepSeek-V3-032427.5
Qwen3 1.7B24.3
Qwen3 VL 2B Thinking22.8
Qwen3 VL 2B Instruct10.9
GPT-4.1 Nano9.7
ChatGPT-4o Latest observed 2025-03-277.9
Loading Atlas data…