Atlas

Benchmarks

← All benchmarks

Humanity's Last Exam Diamond (Reasoning Partition)

General QA

The 500-question reasoning partition of Humanity's Last Exam Diamond (the Scale AI and Center for AI Safety 1,000-question revision, split evenly between reasoning and knowledge questions). Accuracy is the share of the partition's questions judged correct, pass@1, from the same run as the overall HLE-Diamond score.

Top models (higher is better)

ModelScore
Gemini 4 Carbon79.6
GPT-6 Astra78.0
GPT-6.1 Sol76.2
Claude Sonnet 5.568.0
GPT-6.1 Terra65.4
Gemini 4 Argon64.8
Muse Wonder Full61.2
GPT-6 Sol59.6
Muse Wonder50.4
Claude Haiku 5.544.8
Kimi K3.1 Pro44.8
Muse Spark 1.343.0
GPT-5.6 Terra40.4
Gemini 3.8 Flash37.2
DeepSeek V4.1 Flash 101734.8
Gemini 3.1 Pro Preview34.8
MiniMax M3.1 Flash34.6
Qwen3.8 Max (0902)33.6
Kimi K333.0
Muse Spark Open33.0
Grok 4.731.2
GPT-6 Luna31.0
DeepSeek V4 Flash Vision Exp27.2
Step 5 Preview26.6
DeepSeek V4 Pro 081325.2
DeepSeek V4.1 Flash24.6
Mistral Large 423.6
GLM-5.323.4
Qwen3.8-Flash-Next23.4
Ling 3.1 Flash 101923.2
GLM-5.3 Flash22.0
Mistral Large 4 Preview22.0
Qwen3.8 27B22.0
MiMo-V2.6-Pro19.0
Quasar 438B18.8
Kimi K2.7 Code18.4
Qwen3.7-Plus (source unspecified)18.0
Beam 1.0 501B A23B17.8
GPT-5.5 Instant (2026-06-25 hosted snapshot)17.8
MiMo-V2.6-Flash17.4
Loading Atlas data…