Benchmarks
331 sources · 1,258 models × 2,980 benchmarks · 155,643 scoresThe web security category of Wiz's Cyber Model Arena v3.9 (Web Sec on the leaderboard): 29 capture-the-flag challenges from the public websec.fr site, in which an agent reads the PHP source a challenge exposes and writes a working exploit to capture its flag. Wiz notes that websec.fr is a known corpus, so isolation stops lookups but not recall from training. Pass@1 averages three attempts per challenge, for a model in a general-purpose harness.
No signal or difficulty estimate. Held out of the fit by design.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 3.8 Flash Cyber | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 90.8 | |
| 2 | GPT-6 Sol | high · Claude Code | 88.5 | |
| 3 | Gemini 3.7 Flash | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 85.1 | |
| 4 | GPT-5.6 Sol | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 85.1 | |
| 5 | Claude Opus 5 | high · Claude Code | 81.6 | |
| 6 | Gemini 3.5 Flash | high · Claude Code | 81.6 | |
| 7 | Gemini 3.6 Flash | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 81.6 | |
| 8 | GPT-6 Luna | high · Codex | 80.5 | |
| 9 | GPT-5.6 Terra | high · Claude Code | 79.3 | |
| 10 | GPT-6.1 Sol | high · Claude Code | 79.3 | |
| 11 | Opus 4.8 | high · Claude Code | 74.7 | |
| 12 | Gemini 4 Argon | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 74.7 | |
| 13 | GPT-6 Astra | high · Codex | 71.3 | |
| 14 | Sonnet 5 | high · Claude Code | 67.8 | |
| 15 | Grok 4.6 | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 67.8 | |
| 16 | GLM-5.3 | high · Claude Code | 65.5 | |
| 17 | DeepSeek V4 Pro 0813 | high · Claude Code | 62.1 | |
| 18 | DeepSeek V4.1 Flash 1017 | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 60.9 | |
| 19 | Kimi K3 | high · Claude Code | 60.9 | |
| 20 | Claude Haiku 5.5 | high · Claude Code | 52.9 | |
| 21 | Sonnet 4.5 | high · Claude Code | 50.6 | |
| 22 | GLM-5.3 Flash | high · Claude Code | 49.4 | |
| 23 | DeepSeek V4.1 Flash | high · Claude Code | 44.8 | |
| 24 | MiMo-V2.6-Pro | high · Wiz Cyber Model Arena ADK React; simple ReAct loop built with ADK; single bash tool; no cyber-specific tools; general system prompt | 31.0 |