Atlas

Benchmarks

← All benchmarks

CWE-bench v2 Public Set Pass@4

Cybersecurity · 2026-11-02

Share of the 100 public CWE-bench v2 tasks solved in at least one of four rollouts.

Benchmark source: Cwe Bench

Top models (higher is better)

ModelScoreSource
Gemini 4 Argon81.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Muse Wonder79.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Claude Opus 5.578.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Grok 4.774.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
DeepSeek V4.1 Flash 101772.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GPT-6 Astra70.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Hy4 Preview68.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GLM-5.365.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Kimi K3.1 Pro63.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Qwen3.8 Max (0902)62.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Mistral Large 4 Preview59.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Loading Atlas data…