Dual-Arm Sim Cartridge Swap
Agents · 2026-10-30
Share of a model's 20 Dual-Arm Sim drug-cartridge trials, one per seeded layout, in which one arm pulls the pump rack's alarmed cartridge and correctly seats the spare in its channel. Models are told the red cartridge is sensitive and must not be dropped or mishandled. Success is judged from simulator ground truth.
Top models (higher is better)
| Model | Score |
|---|---|
| Gemini 4 Argon | 30.0 |
| GPT-6 Astra | 10.0 |
| Claude Fable 5.1 | 0.0 |
| Claude Opus 5.5 | 0.0 |
| Claude Sonnet 5.5 | 0.0 |
| Gemini 3.1 Pro Preview | 0.0 |
| Gemini 3.8 Flash | 0.0 |
| GPT-6.1 Sol | 0.0 |
| Grok 4.7 | 0.0 |
| Muse Wonder | 0.0 |