Atlas

Benchmarks

← All benchmarks

Drone-Bench: Detect

Agents · 2026-07-23

Drone-Bench's Detect task: given a reference photo of a person's face, the agent builds a detector that returns a whole-body bounding box around that person in each frame of real drone video, and may keep state across frames. Submissions are scored against Andon's own labels on how well the box matches while the target is on screen and on whether the detector reports the target as absent once they leave the frame. The score is the mean over ten runs of each run's best submission, in percent; Andon's human-plus-AI baseline is 72.1.

Benchmark source: Andonlabs

Top models (higher is better)

ModelScoreSource
Claude Opus 5.588.7Andon Labs Drone-Bench: opus-5.5 Detect average run score · Andon Labs
Claude Fable 587.8Andon Labs Drone-Bench: fable-5 Detect average run score · Andon Labs
Claude Fable 5.185.7Andon Labs Drone-Bench: fable-5.1 Detect average run score · Andon Labs
Opus 4.784.2Andon Labs Drone-Bench: opus-4-7 Detect average run score · Andon Labs
Gemini 3.1 Pro Preview82.4Andon Labs Drone-Bench: gemini-3.1 Detect average run score · Andon Labs
Opus 4.881.0Andon Labs Drone-Bench: opus-4-8 Detect average run score · Andon Labs
Claude Opus 578.5Andon Labs Drone-Bench: opus-5 Detect average run score · Andon Labs
Opus 4.569.8Andon Labs Drone-Bench: opus-4-5 Detect average run score · Andon Labs
GPT-6 Astra67.1Andon Labs Drone-Bench: gpt-6-astra Detect average run score · Andon Labs
GPT-5.563.5Andon Labs Drone-Bench: gpt-5.5 Detect average run score · Andon Labs
GPT-5.6 Sol61.3Andon Labs Drone-Bench: gpt-5.6-sol Detect average run score · Andon Labs
o1 (2024-12-17)58.7Andon Labs Drone-Bench: o1 Detect average run score · Andon Labs
GPT-5.256.1Andon Labs Drone-Bench: gpt-5.2 Detect average run score · Andon Labs
o355.4Andon Labs Drone-Bench: o3 Detect average run score · Andon Labs
GPT-4o (2024-11-20)55.3Andon Labs Drone-Bench: gpt-4o-nov Detect average run score · Andon Labs
Opus 452.9Andon Labs Drone-Bench: opus-4-0 Detect average run score · Andon Labs
Gemini 2.5 Pro50.7Andon Labs Drone-Bench: gemini-2.5 Detect average run score · Andon Labs
GPT-545.3Andon Labs Drone-Bench: gpt-5 Detect average run score · Andon Labs
GPT-4o (source unspecified)38.2Andon Labs Drone-Bench: gpt-4o-may Detect average run score · Andon Labs
Loading Atlas data…