Benchmarks
331 sources · 1,258 models × 2,980 benchmarks · 155,643 scoresWiz Research's Cyber Model Arena, version 3.9 of its Wiz Offensive AI Benchmark, runs agents, each a model in a general-purpose harness (Wiz's ADK React loop, Claude Code, Codex or Antigravity CLI), on 327 offensive-security challenges in four categories: 221 code-vulnerability tasks (name a known vulnerability's root cause in Python, Java or Go source, or exploit a live 1-day CVE), 54 black-box API security labs, 29 websec.fr web CTFs and 23 cloud misconfiguration CTFs. Agents get only the task instruction, run in isolated Docker containers with no CVE databases or external resources, and are stopped after 1,000 seconds; grading is deterministic (API hooks, exact flags, exact root-cause strings, checks that the vulnerable path ran). Each model, harness and challenge runs three times at high reasoning effort, and the headline is overall pass@1, the equal-weight mean of the four categories' pass@1 rates; scores are for a model in a harness, not for the model alone.
578th strongest of 785 fitted benchmarks
Signal-to-noise +3.67
409th hardest of 785 fitted benchmarks
Capability needed 149.8
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 4 Argon | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 77.2 | |
| 2 | Gemini 3.8 Flash Cyber | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 74.9 | |
| 3 | Claude Opus 5 | high · Claude Code | 71.2 | |
| 4 | GPT-6 Sol | high · Codex | 71.2 | |
| 5 | GPT-6.1 Sol | high · Claude Code | 70.7 | |
| 6 | GPT-6 Astra | high · Claude Code | 70.2 | |
| 7 | GPT-5.6 Sol | high · Codex | 69.8 | |
| 8 | Gemini 3.7 Flash | high · Antigravity CLI | 65.6 | |
| 9 | Opus 4.8 | high · Claude Code | 65.4 | |
| 10 | GPT-6 Luna | high · Codex | 64.5 | |
| 11 | GPT-5.6 Terra | high · Claude Code | 64.4 | |
| 12 | Gemini 3.6 Flash | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 61.0 | |
| 13 | Gemini 3.5 Flash | high · Claude Code | 60.5 | |
| 14 | DeepSeek V4.1 Flash 1017 | high · Claude Code | 60.3 | |
| 15 | Sonnet 5 | high · Claude Code | 59.3 | |
| 16 | GLM-5.3 | high · Claude Code | 58.0 | |
| 17 | Claude Haiku 5.5 | high · Claude Code | 57.0 | |
| 18 | DeepSeek V4 Pro 0813 | high · Claude Code | 54.4 | |
| 19 | Kimi K3 | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 52.2 | |
| 20 | Sonnet 4.5 | high · Claude Code | 50.5 | |
| 21 | DeepSeek V4.1 Flash | high · Claude Code | 50.2 | |
| 22 | GLM-5.3 Flash | high · Claude Code | 48.2 | |
| 23 | Grok 4.6 | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 46.6 | |
| 24 | MiMo-V2.6-Pro | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 39.7 |