FrontierCUA pass@1
Agents
Collinear AI's private computer-use benchmark of 15 connected workflows across running clones of enterprise applications such as Zendesk and Google Sheets; agents act only through screenshots, clicks, typing and scrolling, and an AI judge grades each attempt against a weighted rubric from the saved application state and trajectory. An attempt passes at a grade of at least 0.95, and pass@1 is the unweighted mean of per-workflow pass rates, so each workflow counts once however many attempts it has.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-6.1 Sol | 46.7 |
| GPT-6 Astra | 42.2 |
| Claude Fable 5 | 40.0 |
| Claude Fable 5.1 | 36.7 |
| Claude Opus 5.5 | 36.0 |
| Sonnet 5 | 20.0 |
| GPT-6 Sol | 20.0 |
| Grok 4.7 | 20.0 |
| Kimi K3 | 20.0 |
| GPT-5.6 Sol | 16.4 |
| DeepSeek V4.1 Flash | 6.7 |
| GLM-5.3 Flash | 6.7 |
| MiMo-V2.6-Pro | 0.0 |