Atlas

Benchmarks

← All benchmarks

LMArena Agent Arena Bash Reliability

Agents

Signed Agent Arena diagnostic for successful bash commands, excluding failures outside the model's control. Atlas retains the publisher's raw bash_reliability_no_prereq sign and scales by 100; this baseline-relative signal can be negative and is not an absolute command-success probability.

Top models (higher is better)

ModelScore
Claude Opus 5.515.8
Sonnet 515.4
Claude Sonnet 5.513.2
GPT-5.6 Sol12.0
Claude Fable 511.9
GPT-6 Sol11.7
Claude Opus 511.3
Gemini 3.8 Flash10.9
GPT-6 Luna10.7
Claude Fable 5.110.6
Grok 4.79.7
Grok 4.69.6
GPT-6 Astra9.3
Muse Wonder Full8.7
Kimi K3.1 Pro8.3
Claude Haiku 5.57.6
Gemini 3.7 Flash6.8
Muse Wonder6.5
DeepSeek V4.1 Flash 10175.1
Qwen3.7-Max (source unspecified)4.0
GPT-6.1 Sol3.9
MiMo-V2.6-Pro3.7
Inkling-Small3.1
DeepSeek V4 Pro 08132.4
Muse Spark 1.32.3
Gemini 3.1 Pro Preview2.3
Qwen3.7-Plus (source unspecified)1.7
GPT-5.6 Terra1.4
Mistral Large 4 Preview1.1
Inkling0.3
MiniMax M3-0.1
DeepSeek V4.1 Flash-0.2
MiMo-V2.5-Pro-0.3
Qwen3.8-Max-0.9
Muse Spark 1.1-1.4
MiMo-V2.6-Flash-1.9
Hy4 Preview-2.2
Kimi K3-2.3
Muse Spark 1.2-3.4
GLM-5.2-4.0
Loading Atlas data…