Atlas

Benchmarks

← All benchmarks

Drone-Bench: Navigate

Agents · 2026-07-23

Drone-Bench's Navigate task: the agent writes a control loop that plans a collision-free path on the obstacle map and flies a simulated DJI Tello to a target room in a MuJoCo model of Andon's office, correcting for noisy controls with a localization function that answers late and only on some calls, as on real hardware. A submission flies to three goals and is scored on whether the drone reaches each one, how optimal its path is and how fast it arrives; a goal that ends in wall contact scores zero. The score is the mean over ten runs of each run's best submission, in percent; Andon's human-plus-AI baseline is 92.0.

Benchmark source: Andonlabs

Top models (higher is better)

ModelScoreSource
GPT-6 Astra98.2Andon Labs Drone-Bench: gpt-6-astra Navigate average run score · Andon Labs
Claude Opus 5.596.7Andon Labs Drone-Bench: opus-5.5 Navigate average run score · Andon Labs
Opus 4.893.7Andon Labs Drone-Bench: opus-4-8 Navigate average run score · Andon Labs
GPT-5.6 Sol91.7Andon Labs Drone-Bench: gpt-5.6-sol Navigate average run score · Andon Labs
Opus 4.789.1Andon Labs Drone-Bench: opus-4-7 Navigate average run score · Andon Labs
GPT-5.588.4Andon Labs Drone-Bench: gpt-5.5 Navigate average run score · Andon Labs
Claude Fable 5.185.2Andon Labs Drone-Bench: fable-5.1 Navigate average run score · Andon Labs
Claude Opus 584.7Andon Labs Drone-Bench: opus-5 Navigate average run score · Andon Labs
Opus 4.582.2Andon Labs Drone-Bench: opus-4-5 Navigate average run score · Andon Labs
Gemini 3.1 Pro Preview78.3Andon Labs Drone-Bench: gemini-3.1 Navigate average run score · Andon Labs
GPT-5.278.3Andon Labs Drone-Bench: gpt-5.2 Navigate average run score · Andon Labs
Claude Fable 568.5Andon Labs Drone-Bench: fable-5 Navigate average run score · Andon Labs
GPT-561.9Andon Labs Drone-Bench: gpt-5 Navigate average run score · Andon Labs
o356.2Andon Labs Drone-Bench: o3 Navigate average run score · Andon Labs
Gemini 2.5 Pro48.6Andon Labs Drone-Bench: gemini-2.5 Navigate average run score · Andon Labs
Opus 439.7Andon Labs Drone-Bench: opus-4-0 Navigate average run score · Andon Labs
o1 (2024-12-17)35.1Andon Labs Drone-Bench: o1 Navigate average run score · Andon Labs
GPT-4o (2024-11-20)19.4Andon Labs Drone-Bench: gpt-4o-nov Navigate average run score · Andon Labs
GPT-4o (source unspecified)12.6Andon Labs Drone-Bench: gpt-4o-may Navigate average run score · Andon Labs
Loading Atlas data…