Atlas

Benchmarks

Infrathon (mean rank score)

Infrathon (University of Washington and AI2) gives coding agents 25 GPU infrastructure-optimization tasks, 11 operator, 5 module and 9 system tasks such as kernels, attention modules and serving stacks, with 12- or 24-hour budgets on H100s, and measures each submission's best throughput or latency in the task's own unit. Because the task metrics have no common baseline, the headline ranks the six evaluated agents on each task and averages a rank score of 100 × (6 − rank) / 5. Scores are relative to the paper's six-agent cohort, so they are diagnostic and not comparable with other cohorts.

Models
5
Top score
91.2
Leader
Claude Opus 5.5
Updated
Nov 9, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
5 dated models · 4 frontier modelsClosed weightsOpen weights
Data: University of Washingtonatlas.village.dev

Infrathon (mean rank score) leaderboard

Loading Atlas data…