Atlas

Benchmarks

VIALS-AA (average of 3)

Artificialanalysis

Correctness averaged over three repeats per task. Artificial Analysis' own run of Handshake AI's 161-task VIALS life-sciences image set in Stirrup with Python and no network, plus an image-viewing tool for vision-capable models, three repeats per task and GPT-6 Luna (medium) grading. A repeat with no answer scores zero. Handshake's own protocol is the vials benchmark, so this stays separate.

Models
19
Top score
68.3
Leader
GPT-6 Astra
Updated
—
Resolution
—
Saturation
—
Signal
42ndpercentile
205 benchmarks from 0.8 to 3.6219 benchmarks from 3.6 to 6.4134 benchmarks from 6.4 to 9.393 benchmarks from 9.3 to 12.155 benchmarks from 12.1 to 14.925 benchmarks from 14.9 to 17.713 benchmarks from 17.7 to 20.55 benchmarks from 20.5 to 23.37 benchmarks from 23.3 to 26.27 benchmarks from 26.2 to 29.01 benchmark from 29.0 to 31.83 benchmarks from 31.8 to 34.66 benchmarks from 34.6 to 37.43 benchmarks from 37.4 to 40.21 benchmark from 40.2 to 43.11 benchmark from 45.9 to 48.71 benchmark from 65.6 to 68.4

450th strongest of 779

Signal-to-noise +5.00 for the VIALS family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

19 dated models · 2 frontier modelsClosed weightsOpen weights
Data: Artificial Analysisatlas.village.dev
#ModelSettingScoreSource
1GPT-6 Astramax · Stirrup
68.3
2Gemini 4 Carbonhigh · Stirrup
67.3
3Gemini 4 Argonhigh · Stirrup
66.3
4GPT-6.1 Terramax · Stirrup
66.0
5Claude Sonnet 5.5max · Stirrup
65.4
6GPT-6.1 Solmax · Stirrup
64.8
7Muse Wondermax · Stirrup
64.8
8Claude Haiku 5.5max · Stirrup
60.5
9Kimi K3.1 Pro— · Stirrup
60.0
10MiMo-V2.6-Prothinking · Stirrup
58.4
11Inkling 2 Small0.99 · Stirrup
57.8
12DeepSeek V4.1 Flash 1017max · Stirrup
53.2
13GLM-5.3 Flashmax · Stirrup
53.0
14Grok 4.7x-high · Stirrup
52.4
15Gemini 3.8 Flashhigh · Stirrup
52.0
16Qwen3.8 Max (0902)thinking · Stirrup
50.9
17MiniMax M3.1 Flash— · Stirrup
49.7
18GPT-6 Lunamax · Stirrup
44.1
19Mistral Large 4high · Stirrup
42.0
Loading Atlas data…