Atlas
Benchmarks
326 sources · 1,256 models × 2,956 benchmarks · 154,484 scoresVIALS-AA (pass^3)
The share of tasks answered correctly in all three repeats, AA's headline. Artificial Analysis' own run of Handshake AI's 161-task VIALS life-sciences image set in Stirrup with Python and no network, plus an image-viewing tool for vision-capable models, three repeats per task and GPT-6 Luna (medium) grading. A repeat with no answer scores zero. Handshake's own protocol is the vials benchmark, so this stays separate.
Models
19
Top score
64.0
Leader
Gemini 4 Carbon
Updated
—
Resolution
—
Saturation
—
Signal
42ndpercentile
450th strongest of 779 fitted benchmarks
Signal-to-noise +5.00 for the VIALS family
Difficulty
Not estimated
Another benchmark represents this family in the fit.
19 dated models · 4 frontier modelsClosed weightsOpen weights
Data: Artificial Analysisatlas.village.dev
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 4 Carbon | high · Stirrup | 64.0 | |
| 2 | GPT-6 Astra | max · Stirrup | 62.7 | |
| 3 | GPT-6.1 Terra | max · Stirrup | 60.2 | |
| 4 | Claude Sonnet 5.5 | max · Stirrup | 59.6 | |
| 5 | Gemini 4 Argon | high · Stirrup | 59.6 | |
| 6 | GPT-6.1 Sol | max · Stirrup | 59.0 | |
| 7 | Muse Wonder | max · Stirrup | 55.3 | |
| 8 | Claude Haiku 5.5 | max · Stirrup | 49.1 | |
| 9 | Kimi K3.1 Pro | — · Stirrup | 45.3 | |
| 10 | MiMo-V2.6-Pro | thinking · Stirrup | 43.5 | |
| 11 | Inkling 2 Small | 0.99 · Stirrup | 42.9 | |
| 12 | Gemini 3.8 Flash | high · Stirrup | 41.0 | |
| 13 | DeepSeek V4.1 Flash 1017 | max · Stirrup | 40.4 | |
| 14 | GLM-5.3 Flash | max · Stirrup | 39.8 | |
| 15 | Grok 4.7 | x-high · Stirrup | 37.9 | |
| 16 | Qwen3.8 Max (0902) | thinking · Stirrup | 31.7 | |
| 17 | MiniMax M3.1 Flash | — · Stirrup | 29.8 | |
| 18 | GPT-6 Luna | max · Stirrup | 27.3 | |
| 19 | Mistral Large 4 | high · Stirrup | 20.5 |
