Atlas

Benchmarks

← All benchmarks

Humanity's Last Exam Diamond (Knowledge Partition)

General QA

The 500-question knowledge partition of Humanity's Last Exam Diamond (the Scale AI and Center for AI Safety 1,000-question revision, split evenly between reasoning and knowledge questions). Accuracy is the share of the partition's questions judged correct, pass@1, from the same run as the overall HLE-Diamond score.

Top models (higher is better)

ModelScore
Gemini 4 Carbon58.6
GPT-6 Astra49.6
Gemini 4 Argon48.6
GPT-6.1 Sol43.6
Claude Sonnet 5.538.6
Muse Wonder Full35.8
GPT-6 Sol30.8
Kimi K3.1 Pro29.8
GPT-6.1 Terra29.2
Gemini 3.8 Flash29.0
Gemini 3.1 Pro Preview28.0
Muse Wonder27.6
Muse Spark 1.324.4
Step 5 Preview22.0
MiniMax M3.1 Flash21.6
Kimi K320.8
Muse Spark Open19.6
GPT-5.6 Terra17.2
MiniMax M317.0
Grok 4.716.0
DeepSeek V4.1 Flash 101715.8
DeepSeek V4 Flash Vision Exp15.0
Claude Haiku 5.514.6
GLM-5.3 Flash14.4
Qwen3.8 Max (0902)14.4
DeepSeek V4 Pro 081313.8
DeepSeek V4.1 Flash13.6
GPT-6 Luna13.4
GLM-5.312.4
GPT-5.5 Instant (2026-06-25 hosted snapshot)11.4
MiMo-V2.6-Pro11.4
Kimi K2.7 Code11.2
Ling 3.1 Flash 101911.2
Mistral Large 411.0
LongCat-2.010.4
MiMo-V2.6-Flash10.0
Qwen3.7-Plus (source unspecified)9.8
Gemini 3.5 Flash-Lite9.4
Qwen3.8-Flash-Next9.2
Qwen3.5 397B A17B9.0
Loading Atlas data…