Atlas

Benchmarks

FrontierRSI (avg@2, relative to the best trial)

Abundant AI's FrontierRSI asks whether an AI agent can do the research and engineering needed to improve AI itself. Its 27 open-ended tasks, five in pre-training, eight in agentic post-training and harness design, five in inference and serving and nine in H100 GPU kernels, each state a goal to optimize (held-out loss, latency, throughput or a held-out success rate) with no target to reach, and give the agent 45 minutes to 8 hours on one or two H100 or A100 GPUs. A trial's reward is relative to the best valid trial any evaluated model reached on the task: the best scores 1, a result 10% or more worse scores 0, with a linear ramp between, and a trial that fails a correctness, accuracy or resource check scores 0. A model's task score is the mean of two trials (avg@2) and its score the mean over the 27 tasks, in percent. Because the reference is the cohort's own best trial, a stronger new model lowers everyone else's score, so this is a diagnostic. Unrelated to Synthetic Sciences' FrontierML, whose released tasks were briefly named FrontierRSI.

Models
9
Top score
34.3
Leader
Claude Opus 5.5
Updated
—
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
9 dated models · 2 frontier modelsClosed weightsOpen weights
Data: Abundant AIatlas.village.dev

FrontierRSI (avg@2, relative to the best trial) leaderboard

Loading Atlas data…