Atlas

Benchmarks

FrontierCUA v1 avg@1

Partial-credit companion to FrontierCUA v1 pass@1 on the same 40 enterprise computer-use workflows: the mean over workflows of each workflow's graded attempt score, the weighted share of rubric checks met on a 0-1 scale. The leaderboard uses it to break pass@1 ties.

Models
25
Top score
0.6
Leader
Gemini 4 Carbon
Updated
Nov 20, 2026
Resolution
—
Saturation
—
Signal
67thpercentile
141 benchmarks from 0.8 to 2.9196 benchmarks from 2.9 to 5.0131 benchmarks from 5.0 to 7.1105 benchmarks from 7.1 to 9.282 benchmarks from 9.2 to 11.365 benchmarks from 11.3 to 13.327 benchmarks from 13.3 to 15.421 benchmarks from 15.4 to 17.58 benchmarks from 17.5 to 19.68 benchmarks from 19.6 to 21.76 benchmarks from 21.7 to 23.84 benchmarks from 23.8 to 25.95 benchmarks from 25.9 to 28.03 benchmarks from 28.0 to 30.12 benchmarks from 30.1 to 32.14 benchmarks from 32.1 to 34.21 benchmark from 34.2 to 36.33 benchmarks from 36.3 to 38.41 benchmark from 38.4 to 40.52 benchmarks from 40.5 to 42.61 benchmark from 42.6 to 44.71 benchmark from 44.7 to 46.81 benchmark from 48.9 to 50.9

267th strongest of 818

Signal-to-noise +8.69 for the FrontierCUA v1 pass@1 family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

Organizations
25 dated models · 5 frontier modelsClosed weightsOpen weights
Data: Collinear AIatlas.village.dev

FrontierCUA v1 avg@1 leaderboard

#ModelSettingScoreSource
1Gemini 4 Carbonhigh
0.6
2GPT-6.2 Astrahigh · Codex
0.6
3GPT-6.1 Solhigh · Codex
0.5
4GPT-6 Astrahigh · Codex
0.5
5GPT-6.2 Solhigh · Codex
0.5
6Claude Fable 5.1high
0.5
7Claude Opus 5.5high
0.4
8Claude Fable 5high
0.4
9Claude Opus 5high
0.4
10MiniMax M3.1 Flashmax
0.4
11Muse Wonderhigh
0.4
12Muse Emberhigh
0.4
13Qwen4-Maxhigh · Qwen-Agent computer-use harness (OSWorld-V2 QwenAgent port) via OpenRouter
0.4
14Claude Fable 5.2high
0.4
15Kimi K3high
0.4
16Sonnet 5high
0.4
17MiMo-V2.6-Flashhigh
0.3
18GPT-6 Solhigh · Codex
0.3
19GPT-6.1 Terrahigh · Codex
0.3
20Kimi K3.1 Prohigh
0.3
21MiMo-V2.6-Prohigh
0.3
22Grok 4.7high
0.3
23GPT-5.6 Solhigh · Codex
0.3
24GLM-5.3 Flashhigh · GLM-5.3-FlashX inference-speed tier via Alibaba Cloud
0.3
25Muse Spark 1.3high
0.1

Related benchmarks

Loading Atlas data…