Atlas

Benchmarks

← All benchmarks

CWE-bench v2: Rust

Cybersecurity · 2026-11-02

Pass@1 across the 13 Rust tasks of CWE-bench v2's public and held-out sets, averaging four rollouts per task and rounded to a whole point by the publisher.

Benchmark source: Cwe Bench

Top models (higher is better)

ModelScoreSource
Claude Opus 5.587.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Gemini 4 Argon87.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Muse Wonder79.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
DeepSeek V4.1 Flash 101777.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Qwen3.8 Max (0902)77.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GPT-6 Astra71.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Grok 4.771.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
GLM-5.365.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Hy4 Preview62.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Kimi K3.1 Pro62.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Mistral Large 4 Preview60.0CWE-bench v2 leaderboard (snapshot 2026-11-03) · Collinear AI
Loading Atlas data…