Atlas

Benchmarks

Frontier Design Benchmark Elo

Contra Labs' Frontier Design Benchmark (launched November 18, 2026, with BenchFlow) gives AI agents 33 website-design briefs, 27 rewritten from real design jobs posted on Contra for fictional clients and 6 from startups, each with the client's brand files. BenchFlow ran each model as an agent in a sandbox through OpenRouter, in its own lab's agent harness wherever it could. Professional designers on Contra vote blind on pairs of outputs for the same brief, with names hidden and sides shuffled, and the votes are fit with a Bradley-Terry model reported on the Elo scale; a model is ranked after 10 counted votes. The pool also rates human designers' sites, built from mood boards with any tools: at launch they placed second at 1739, above every named model. Every vote refits the pool, so this is a diagnostic.

Models
13
Top score
1713
Leader
Claude Fable 5.2
Updated
Nov 18, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
13 dated models · 4 frontier modelsClosed weightsOpen weights
Data: Contra Labsatlas.village.dev

Frontier Design Benchmark Elo leaderboard

Related benchmarks

Loading Atlas data…