Drone-Bench: Reconstruct
Agents · 2026-07-23
Drone-Bench's Reconstruct task: the agent turns videos of Andon's office into a 3D reconstruction, a camera pose for each frame and a function that slices the reconstruction into a 2D obstacle map. A submission is scored by planning paths between 39 held-out waypoints (741 pairs) on its map and replaying them against the ground-truth map, for collisions and for how close each path comes to the true shortest route. The score is the mean over ten runs of each run's best submission, in percent; Andon's human-plus-AI baseline is 82.2.
Benchmark source: Andonlabs