Atlas

Benchmarks

AutoRLBench v2 (solution level)

GitHub

The repair level of AutoRLBench's second task list, which 24 of its 32 failed reinforcement-learning runs support. The agent repairs a writable copy of the run's workspace and submits a report without launching training; the harness reruns the experiment on the repaired workspace and grades only that fresh run against a metric threshold, and repairs that game the reward or rely on fetched upstream material fail. Each model runs each task once.

Models
6
Top score
57.9
Leader
GPT-6.1 Sol
Updated
—
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

6 dated models · 3 frontier modelsClosed weightsOpen weights
Data: AutoRLBench Authorsatlas.village.dev
Loading Atlas data…