Atlas

Benchmarks

← All benchmarks

CWE-bench v2: Memory and Resource Safety

Cybersecurity · 2026-11-02

Pass@1 on the 40 tasks of Collinear AI's K03 weakness class in CWE-bench v2, rounded to a whole point by the publisher. The ten classes are the publisher's own grouping, not an official taxonomy.

Benchmark source: Cwe Bench

Top models (higher is better)

ModelScoreSource
Claude Opus 5.574.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Gemini 4 Argon71.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Muse Wonder69.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
DeepSeek V4.1 Flash 101766.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GPT-6 Astra63.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Hy4 Preview56.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Grok 4.751.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Mistral Large 4 Preview51.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GLM-5.348.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Kimi K3.1 Pro44.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Qwen3.8 Max (0902)43.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Loading Atlas data…