Benchmarks
331 sources · 1,258 models × 2,980 benchmarks · 155,643 scoresGoogle DeepMind's Multimodal Knowledge Agent (MKA) benchmark as run by Artificial Analysis, which holds its 200 private tasks: multi-step professional projects across 10 verticals, written with experts in 83 occupations, whose key information sits in visual files such as architectural drawings, engineering schematics, clinical scans, spreadsheets and slide decks. The agent gets a workspace of input files and must produce the deliverables a professional would (a report, spreadsheet, slide deck or marked-up drawing), working in Stirrup with a 250-turn limit, a Linux sandbox with code execution and web access, and an image-viewing tool for models with image input; each task runs once. A GPT-6 Luna (medium) agentic judge inspects the submitted files and final response and marks every expert-written rubric criterion, weighted 1 to 5, satisfied or not. Climb WSR, the headline, is the mean over tasks of the weighted share of the harder Climb criteria satisfied. Scores are for a model in Stirrup, not for the model alone.
37th strongest of 785 fitted benchmarks
Signal-to-noise +20.57
163rd hardest of 785 fitted benchmarks
Capability needed 166.7
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 4 Carbon | high · Stirrup | 54.3 | |
| 2 | Claude Sonnet 5.5 | max · Stirrup | 52.0 | |
| 3 | Gemini 4 Argon | high · Stirrup | 51.3 | |
| 4 | GPT-6 Astra | max · Stirrup | 50.2 | |
| 5 | GPT-6.1 Sol | max · Stirrup | 47.7 | |
| 6 | Muse Wonder | max · Stirrup | 47.5 | |
| 7 | Kimi K3.1 Pro | — · Stirrup | 43.9 | |
| 8 | GPT-6.1 Terra | max · Stirrup | 43.8 | |
| 9 | Claude Haiku 5.5 | max · Stirrup | 41.0 | |
| 10 | Grok 4.7 | x-high · Stirrup | 40.1 | |
| 11 | DeepSeek V4.1 Flash 1017 | max · Stirrup | 38.5 | |
| 12 | Qwen3.8 Max (0902) | thinking · Stirrup | 37.4 | |
| 13 | MiMo-V2.6-Pro | thinking · Stirrup | 37.3 | |
| 14 | GPT-6 Luna | max · Stirrup | 36.8 | |
| 15 | GLM-5.3 Flash | max · Stirrup | 36.2 | |
| 16 | Gemini 3.8 Flash | high · Stirrup | 35.3 | |
| 17 | Mistral Large 4 | high · Stirrup | 35.1 | |
| 18 | MiniMax M3.1 Flash | — · Stirrup | 33.5 | |
| 19 | Step 5 Preview | — · Stirrup | 27.6 |