Drone-Bench: Localize
Agents · 2026-07-23
Drone-Bench's Localize task: using the office videos and their known camera poses, the agent builds a function that estimates the drone's pose in the 3D reconstruction from a single camera frame. Each of 50 held-out query frames is scored on accuracy and speed, and a submission's score is the mean of its best 80% of queries, since some frames are corrupt. The score is the mean over ten runs of each run's best submission, in percent; Andon's human-plus-AI baseline is 84.0.
Benchmark source: Andonlabs