Atlas

Benchmarks

VIALS-AA (pass@3)

Artificialanalysis

The share of tasks answered correctly at least once in three repeats. Artificial Analysis' own run of Handshake AI's 161-task VIALS life-sciences image set in Stirrup with Python and no network, plus an image-viewing tool for vision-capable models, three repeats per task and GPT-6 Luna (medium) grading. A repeat with no answer scores zero. Handshake's own protocol is the vials benchmark, so this stays separate.

Models
19
Top score
73.9
Leader
Kimi K3.1 Pro
Updated
—
Resolution
—
Saturation
—
Signal
42ndpercentile
205 benchmarks from 0.8 to 3.6219 benchmarks from 3.6 to 6.4134 benchmarks from 6.4 to 9.393 benchmarks from 9.3 to 12.155 benchmarks from 12.1 to 14.925 benchmarks from 14.9 to 17.713 benchmarks from 17.7 to 20.55 benchmarks from 20.5 to 23.37 benchmarks from 23.3 to 26.27 benchmarks from 26.2 to 29.01 benchmark from 29.0 to 31.83 benchmarks from 31.8 to 34.66 benchmarks from 34.6 to 37.43 benchmarks from 37.4 to 40.21 benchmark from 40.2 to 43.11 benchmark from 45.9 to 48.71 benchmark from 65.6 to 68.4

450th strongest of 779

Signal-to-noise +5.00 for the VIALS family

Difficulty
Not estimated

Another benchmark represents this family in the fit.

19 dated models · 4 frontier modelsClosed weightsOpen weights
Data: Artificial Analysisatlas.village.dev
#ModelSettingScoreSource
1Kimi K3.1 Pro— · Stirrup
73.9
2Muse Wondermax · Stirrup
73.9
3GPT-6 Astramax · Stirrup
73.3
4Gemini 4 Argonhigh · Stirrup
72.7
5Qwen3.8 Max (0902)thinking · Stirrup
72.7
6Inkling 2 Small0.99 · Stirrup
72.0
7Claude Haiku 5.5max · Stirrup
71.4
8GPT-6.1 Terramax · Stirrup
71.4
9Claude Sonnet 5.5max · Stirrup
70.8
10Gemini 4 Carbonhigh · Stirrup
70.8
11GPT-6.1 Solmax · Stirrup
70.8
12MiMo-V2.6-Prothinking · Stirrup
70.8
13MiniMax M3.1 Flash— · Stirrup
70.8
14GLM-5.3 Flashmax · Stirrup
67.1
15DeepSeek V4.1 Flash 1017max · Stirrup
66.5
16Grok 4.7x-high · Stirrup
65.8
17Gemini 3.8 Flashhigh · Stirrup
64.0
18Mistral Large 4high · Stirrup
62.7
19GPT-6 Lunamax · Stirrup
61.5
Loading Atlas data…