Atlas

Benchmarks

Co-Design Bench Graded Completion

arXiv

Co-Design Bench's graded completion over the same 273 tasks: after the verifier's refutation pass each hidden acceptance criterion scores 1 for PASS, 0.5 for PARTIAL and 0 for FAIL, averaged within a task and then over tasks with equal weight. It is never below strict completion, which gives PARTIAL no credit.

Models
10
Top score
75.3
Leader
GPT-6 Astra
Updated
Oct 26, 2026
Resolution
—
Saturation
—
Signal
30thpercentile
205 benchmarks from 0.8 to 3.6219 benchmarks from 3.6 to 6.4134 benchmarks from 6.4 to 9.393 benchmarks from 9.3 to 12.155 benchmarks from 12.1 to 14.925 benchmarks from 14.9 to 17.713 benchmarks from 17.7 to 20.55 benchmarks from 20.5 to 23.37 benchmarks from 23.3 to 26.27 benchmarks from 26.2 to 29.01 benchmark from 29.0 to 31.83 benchmarks from 31.8 to 34.66 benchmarks from 34.6 to 37.43 benchmarks from 37.4 to 40.21 benchmark from 40.2 to 43.11 benchmark from 45.9 to 48.71 benchmark from 65.6 to 68.4

547th strongest of 779

Signal-to-noise +3.91 for the Co-Design Bench family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

10 dated models · 5 frontier modelsClosed weightsOpen weights
Data: Co-Design Bench Authorsatlas.village.dev
#ModelSettingScoreSource
1GPT-6 Astranot reported · Claude Code
75.3
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
2Claude Opus 5not reported · Claude Code
71.9
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
3Qwen3.8 Max (0902)not reported · Claude Code
71.6
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
4Qwen3.8 27Bnot reported · Claude Code
70.9
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
5Kimi K3not reported · Claude Code
69.5
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
6GPT-5.6 Solnot reported · Claude Code
67.9
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
7Opus 4.8not reported · Claude Code
64.9
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
8GLM-5.3 Flashnot reported · Claude Code
63.9
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
9GLM-5.2not reported · Claude Code
63.7
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
10Grok 4.6not reported · Claude Code
58.0
Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
Loading Atlas data…