Atlas

Benchmarks

← All benchmarks

GDPval Extended (Mercor held-out rubric score)

Professional Work

Mercor's held-out Extended twin of OpenAI's GDPval: 132 Mercor knowledge-work tasks graded by Mercor's rubric mean score. Like its public twin, Mercor's 213-task GDPval rubric score (gdpval-mercor-213-rubric, under gdpval), the rubric is undocumented and differs from GDPval's blind expert pairwise grading, so this is a diagnostic. Mercor does not publish the held-out tasks or say how they were drawn or written, so this is its own benchmark, not a component of the public one.

Top models (higher is better)

ModelScore
Gemini 4 Argon76.4
Claude Opus 5.575.8
Claude Sonnet 5.570.9
Claude Fable 5.168.7
Claude Haiku 5.566.0
Claude Fable 565.3
GPT-6 Astra64.1
Claude Opus 562.9
Grok 4.661.8
Gemini 3.8 Flash60.4
Opus 4.858.9
GPT-6 Sol58.7
Gemini 3.7 Flash57.8
Muse Spark 1.257.5
Kimi K356.4
Muse Spark 1.355.9
GPT-5.554.5
Sonnet 554.2
Opus 4.753.8
Opus 4.653.0
Muse Spark 1.152.4
Gemini 3.6 Flash52.2
GPT-5.6 Sol Pro52.0
Sonnet 4.651.0
Grok 4.551.0
GPT-6 Luna48.9
GPT-5.448.0
GLM-5.247.3
GPT-5.6 Terra47.2
GPT-5.6 Luna44.9
Gemini 3.1 Pro Preview41.9
Kimi K2.7 Code41.0
Inkling39.5
MiniMax M338.8
Nemotron 3 Ultra 550B A55B (NVFP4)38.2
Qwen3.5 397B A17B35.4
MiniMax M2.732.4
Gemini 3.5 Flash31.6
Kimi K2 Thinking26.0
Loading Atlas data…