Atlas

Benchmarks

Co-Design Bench Full-Pass Rate

arXiv

Share of Co-Design Bench's 273 tasks in which every hidden acceptance criterion is judged PASS after the verifier's refutation pass, so the whole requested revision is delivered.

Models
10
Top score
26.4
Leader
GPT-6 Astra
Updated
Oct 26, 2026
Resolution
—
Saturation
—
Signal
30thpercentile
205 benchmarks from 0.8 to 3.6219 benchmarks from 3.6 to 6.4134 benchmarks from 6.4 to 9.393 benchmarks from 9.3 to 12.155 benchmarks from 12.1 to 14.925 benchmarks from 14.9 to 17.713 benchmarks from 17.7 to 20.55 benchmarks from 20.5 to 23.37 benchmarks from 23.3 to 26.27 benchmarks from 26.2 to 29.01 benchmark from 29.0 to 31.83 benchmarks from 31.8 to 34.66 benchmarks from 34.6 to 37.43 benchmarks from 37.4 to 40.21 benchmark from 40.2 to 43.11 benchmark from 45.9 to 48.71 benchmark from 65.6 to 68.4

547th strongest of 779

Signal-to-noise +3.91 for the Co-Design Bench family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

10 dated models · 5 frontier modelsClosed weightsOpen weights
Data: Co-Design Bench Authorsatlas.village.dev
#ModelSettingScoreSource
1GPT-6 Astranot reported · Claude Code
26.4
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
2Claude Opus 5not reported · Claude Code
18.3
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
3Qwen3.8 Max (0902)not reported · Claude Code
16.5
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
4Kimi K3not reported · Claude Code
15.8
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
5Qwen3.8 27Bnot reported · Claude Code
15.0
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
6GPT-5.6 Solnot reported · Claude Code
14.3
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
7GLM-5.3 Flashnot reported · Claude Code
10.6
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
8Opus 4.8not reported · Claude Code
10.3
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
9GLM-5.2not reported · Claude Code
9.5
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
10Grok 4.6not reported · Claude Code
6.6
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
Loading Atlas data…