Dual-Arm Sim Instrument Swap
Agents · 2026-10-30
Share of a model's 20 Dual-Arm Sim instrument-swap trials, all on one fixed layout, that end with the marked clamp lifted out and its replacement seated, judged from simulator ground truth.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Fable 5.1 | 0.0 |
| Claude Opus 5.5 | 0.0 |
| Claude Sonnet 5.5 | 0.0 |
| Gemini 3.1 Pro Preview | 0.0 |
| Gemini 3.8 Flash | 0.0 |
| Gemini 4 Argon | 0.0 |
| GPT-6.1 Sol | 0.0 |
| GPT-6 Astra | 0.0 |
| Grok 4.7 | 0.0 |
| Muse Wonder | 0.0 |