Atlas

Benchmarks

← All benchmarks

Dual-Arm Sim (task completion)

Agents · 2026-10-30

micro1's Dual-Arm Sim has a general-purpose model drive two simulated Franka Panda arms at an operating-room instrument trolley in NVIDIA Isaac Sim and Isaac Lab. At each of at most 120 decisions it gets an overhead camera image, a wrist camera image per arm, fingertip positions and gripper openings, and returns relative arm moves, gripper commands, target estimates, a status note and a done flag; the arm executes about 40% of each commanded move, which the model is not told. Four tasks (instrument swap, drug-cartridge swap, two-arm sample transfer and surgical-kit packing) run 20 trials each, on 20 seeded layouts shared by every model, except the instrument swap, which uses one fixed layout. The score is the share of a model's 80 trials in which every task condition, including the arm-use rules, held at the end, judged from simulator ground truth.

Top models (higher is better)

ModelScore
Gemini 4 Argon11.3
GPT-6 Astra2.5
Claude Fable 5.10.0
Claude Opus 5.50.0
Claude Sonnet 5.50.0
Gemini 3.1 Pro Preview0.0
Gemini 3.8 Flash0.0
GPT-6.1 Sol0.0
Grok 4.70.0
Muse Wonder0.0
Loading Atlas data…