Atlas

Benchmarks

← All benchmarks

CWE-bench v2 Pass@4

Cybersecurity · 2026-11-02

Share of the 250 CWE-bench v2 tasks solved in at least one of four one-hour high-reasoning rollouts according to the deterministic exploit and behaviour verifier.

Benchmark source: Cwe Bench

Top models (higher is better)

ModelScoreSource
Claude Opus 5.579.2CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Muse Wonder78.8CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Gemini 4 Argon77.2CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
DeepSeek V4.1 Flash 101773.6CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GPT-6 Astra72.8CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Grok 4.771.2CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Qwen3.8 Max (0902)64.8CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Hy4 Preview64.4CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Kimi K3.1 Pro64.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GLM-5.363.6CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Mistral Large 4 Preview60.4CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Loading Atlas data…