Atlas

Benchmarks

← All benchmarks

Terminal-Bench 2.1 Extended (Mercor held-out)

Code

Mercor's held-out Extended twin of Terminal-Bench 2.1: 99 Mercor long-horizon command-line agent tasks, scored by task accuracy. The public twin is Terminal-Bench 2.1 (terminal-bench-2-1). Mercor does not publish the held-out tasks or say how they were drawn or written, so this is its own benchmark, not a component of the public one.

Top models (higher is better)

ModelScore
Claude Opus 5.547.5
GPT-6.1 Sol45.8
Claude Sonnet 5.545.5
Grok 4.645.5
Gemini 3.7 Flash44.4
Gemini 3.8 Flash44.4
GPT-6 Sol42.4
Gemini 3.6 Flash40.1
GLM-5.339.4
DeepSeek V4.1 Flash38.4
Claude Opus 538.0
GPT-5.538.0
Claude Haiku 5.537.7
GPT-5.6 Sol37.4
GPT-5.6 Terra36.4
Beam 1.0 501B A23B35.7
GPT-5.6 Luna35.4
Gemini 3.1 Pro Preview35.0
GPT-6 Luna33.3
Grok 4.533.3
Opus 4.832.7
GPT-5.431.3
Kimi K331.0
DeepSeek V4 Pro 081330.0
GLM-5.3 Flash30.0
Sonnet 528.9
Gemini 3.5 Flash28.6
GLM-5.227.9
Opus 4.727.6
Inkling24.6
Kimi K2.7 Code23.6
MiniMax M322.2
Claude Fable 5.119.5
Qwen3.5 397B A17B17.8
Sonnet 4.617.5
Claude Fable 516.8
DeepSeek-V3.215.2
Grok 4.711.8
Nemotron 3 Ultra 550B A55B (NVFP4)11.8
Kimi K2 Thinking11.1
Loading Atlas data…