Atlas

Benchmarks

Wiz Cyber Model Arena v3.9 (Cloud Security)

Wiz

The Cloud Security category of Wiz's Cyber Model Arena v3.9: 23 capture-the-flag challenges taken from Wiz's CTF challenges, in which an agent exploits misconfigurations to capture a flag in AWS, Azure, GCP or Kubernetes-style setups. Pass@1 averages three attempts per challenge, for a model in a general-purpose harness.

Models
24
Top score
87.0
Leader
Gemini 4 Argon
Updated
—
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
24 dated models · 6 frontier modelsClosed weightsOpen weights
#ModelSettingScoreSource
1Gemini 4 Argonhigh · Antigravity CLI
87.0
2GPT-6 Astrahigh · Claude Code
72.5
3GPT-6.1 Solhigh · Codex
68.1
4Gemini 3.8 Flash Cyberhigh · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
66.7
5Gemini 3.7 Flashhigh · Antigravity CLI
65.2
6GPT-5.6 Solhigh · Codex
65.2
7GPT-6 Solhigh · Codex
65.2
8Opus 4.8high · Claude Code
63.8
9Claude Opus 5high · Claude Code
63.8
10DeepSeek V4.1 Flash 1017high · Claude Code
62.3
11GPT-5.6 Terrahigh · Codex
62.3
12Gemini 3.6 Flashhigh · Antigravity CLI
58.0
13GPT-6 Lunahigh · Codex
58.0
14Sonnet 5high · Claude Code
56.5
15DeepSeek V4.1 Flashhigh · Claude Code
56.5
16DeepSeek V4 Pro 0813high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
53.6
17Claude Haiku 5.5high · Claude Code
50.7
18Sonnet 4.5high · Claude Code
50.7
19GLM-5.3high · Claude Code
50.7
20Gemini 3.5 Flashhigh · Claude Code
49.3
21Kimi K3high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
49.3
22GLM-5.3 Flashhigh · Claude Code
42.0
23Grok 4.6high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
39.1
24MiMo-V2.6-Prohigh · Claude Code
36.2
Loading Atlas data…