Co-Design Bench Repository Editing

Name: Co-Design Bench Repository Editing results
Creator: Village

Strict completion on Co-Design Bench's 173 Repository Editing tasks: coordinated changes to components, routes, state, data flow and content in runnable multi-file frontend repositories. Experts split compound requests into 1,778 separately auditable criteria, about 10.3 per task, and 166 tasks need two or more edit types.

Models

Top score

66.7

Leader

GPT-6 Astra

Updated

Oct 26, 2026

Resolution

—

Saturation

—

Signal

30thpercentile

547th strongest of 779 fitted benchmarks

Signal-to-noise +3.91 for the Co-Design Bench family

Difficulty

Not estimated

Another benchmark represents this family in the fit.

10 dated models · 5 frontier modelsClosed weightsOpen weights

Show projectionFrontier only

Data: Co-Design Bench Authorsatlas.village.dev

#	Model	Setting	Score	Source
1	GPT-6 Astra	not reported · Claude Code	66.7	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
2	Qwen3.8 27B	not reported · Claude Code	64.5	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
3	Qwen3.8 Max (0902)	not reported · Claude Code	64.4	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
4	Claude Opus 5	not reported · Claude Code	64.2	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
5	GPT-5.6 Sol	not reported · Claude Code	62.7	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
6	Kimi K3	not reported · Claude Code	61.0	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
7	GLM-5.3 Flash	not reported · Claude Code	59.4	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
8	Opus 4.8	not reported · Claude Code	57.5	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
9	GLM-5.2	not reported · Claude Code	56.4	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)
10	Grok 4.6	not reported · Claude Code	53.6	Co-Design Bench leaderboard (arXiv 2610.35138v1, Tables 2 and 5)