Atlas

Benchmarks

Wiz Cyber Model Arena v3.9

Wiz

Wiz Research's Cyber Model Arena, version 3.9 of its Wiz Offensive AI Benchmark, runs agents, each a model in a general-purpose harness (Wiz's ADK React loop, Claude Code, Codex or Antigravity CLI), on 327 offensive-security challenges in four categories: 221 code-vulnerability tasks (name a known vulnerability's root cause in Python, Java or Go source, or exploit a live 1-day CVE), 54 black-box API security labs, 29 websec.fr web CTFs and 23 cloud misconfiguration CTFs. Agents get only the task instruction, run in isolated Docker containers with no CVE databases or external resources, and are stopped after 1,000 seconds; grading is deterministic (API hooks, exact flags, exact root-cause strings, checks that the vulnerable path ran). Each model, harness and challenge runs three times at high reasoning effort, and the headline is overall pass@1, the equal-weight mean of the four categories' pass@1 rates; scores are for a model in a harness, not for the model alone.

Models
24
Top score
77.2
Leader
Gemini 4 Argon
Updated
—
Resolution
~6 mo
Useful
Saturation
2027–2029
Projected
Signal
26thpercentile
192 benchmarks from 0.8 to 3.5218 benchmarks from 3.5 to 6.1128 benchmarks from 6.1 to 8.895 benchmarks from 8.8 to 11.567 benchmarks from 11.5 to 14.128 benchmarks from 14.1 to 16.814 benchmarks from 16.8 to 19.49 benchmarks from 19.4 to 22.111 benchmarks from 22.1 to 24.72 benchmarks from 24.7 to 27.46 benchmarks from 27.4 to 30.13 benchmarks from 30.1 to 32.73 benchmarks from 32.7 to 35.45 benchmarks from 35.4 to 38.01 benchmark from 38.0 to 40.71 benchmark from 40.7 to 43.41 benchmark from 43.4 to 46.01 benchmark from 62.0 to 64.6

578th strongest of 785

Signal-to-noise +3.67

Difficulty
48thpercentile
1 benchmark from 6.0 to 14.81 benchmark from 14.8 to 23.72 benchmarks from 32.5 to 41.41 benchmark from 41.4 to 50.22 benchmarks from 50.2 to 59.08 benchmarks from 59.0 to 67.97 benchmarks from 67.9 to 76.719 benchmarks from 76.7 to 85.623 benchmarks from 85.6 to 94.441 benchmarks from 94.4 to 103.331 benchmarks from 103.3 to 112.141 benchmarks from 112.1 to 120.947 benchmarks from 120.9 to 129.872 benchmarks from 129.8 to 138.660 benchmarks from 138.6 to 147.5119 benchmarks from 147.5 to 156.3126 benchmarks from 156.3 to 165.2115 benchmarks from 165.2 to 174.037 benchmarks from 174.0 to 182.818 benchmarks from 182.8 to 191.79 benchmarks from 191.7 to 200.51 benchmark from 200.5 to 209.44 benchmarks from 209.4 to 218.2

409th hardest of 785

Capability needed 149.8

Organizations
24 dated models · 7 frontier modelsClosed weightsOpen weights
#ModelSettingScoreSource
1Gemini 4 Argonhigh · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
77.2
2Gemini 3.8 Flash Cyberhigh · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
74.9
3Claude Opus 5high · Claude Code
71.2
4GPT-6 Solhigh · Codex
71.2
5GPT-6.1 Solhigh · Claude Code
70.7
6GPT-6 Astrahigh · Claude Code
70.2
7GPT-5.6 Solhigh · Codex
69.8
8Gemini 3.7 Flashhigh · Antigravity CLI
65.6
9Opus 4.8high · Claude Code
65.4
10GPT-6 Lunahigh · Codex
64.5
11GPT-5.6 Terrahigh · Claude Code
64.4
12Gemini 3.6 Flashhigh · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
61.0
13Gemini 3.5 Flashhigh · Claude Code
60.5
14DeepSeek V4.1 Flash 1017high · Claude Code
60.3
15Sonnet 5high · Claude Code
59.3
16GLM-5.3high · Claude Code
58.0
17Claude Haiku 5.5high · Claude Code
57.0
18DeepSeek V4 Pro 0813high · Claude Code
54.4
19Kimi K3high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
52.2
20Sonnet 4.5high · Claude Code
50.5
21DeepSeek V4.1 Flashhigh · Claude Code
50.2
22GLM-5.3 Flashhigh · Claude Code
48.2
23Grok 4.6high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
46.6
24MiMo-V2.6-Prohigh · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt
39.7
Loading Atlas data…