Atlas

Benchmarks

← All benchmarks

TasteVal (performance multiplier)

Science · 2026-10-05

TasteVal's performance multiplier: how good the Researcher's final result is relative to the best human expert, whatever compute it took. Each run's official test score is rescaled so the task's naive baseline is 0 and the expert baseline 1, averaged over the seeds of a task with runs below the naive baseline counted as 0, and combined across the 8 tasks by a geometric mean, a task where no run beats the naive baseline entering at 0.01. A value above 1 means the model's final submissions beat the experts'.

Benchmark source: arXiv

Top models (higher is better)

ModelScoreSource
Claude Opus 5.51.1TasteVal paper Table 2 (Opus 5.5 (max)) · P-Zero Research
GPT-6 Astra1.1TasteVal paper Table 2 (GPT-6 Astra (max)) · P-Zero Research
Claude Opus 51.1TasteVal paper Table 2 (Opus 5.0 (max)) · P-Zero Research
Claude Fable 5.11.1TasteVal paper Table 2 (Fable 5.1 (max)) · P-Zero Research
Opus 4.81.0TasteVal paper Table 2 (Opus 4.8 (max)) · P-Zero Research
GPT-5.6 Sol0.9TasteVal paper Table 2 (GPT-5.6 Sol (max)) · P-Zero Research
GLM-5.30.9TasteVal paper Table 2 (GLM 5.3 (max)) · P-Zero Research
Kimi K30.9TasteVal paper Table 2 (Kimi K3 (reasoning on)) · P-Zero Research
GPT-5.50.8TasteVal paper Table 2 (GPT-5.5 (xhigh)) · P-Zero Research
Opus 4.60.8TasteVal paper Table 2 (Opus 4.6 (max)) · P-Zero Research
Opus 4.70.8TasteVal paper Table 2 (Opus 4.7 (max)) · P-Zero Research
GPT-5.20.7TasteVal paper Table 2 (GPT-5.2 (high)) · P-Zero Research
GPT-5.40.6TasteVal paper Table 2 (GPT-5.4 (xhigh)) · P-Zero Research
GPT-50.5TasteVal paper Table 2 (GPT-5 (high)) · P-Zero Research
o30.4TasteVal paper Table 2 (o3 (high)) · P-Zero Research
Opus 4.50.4TasteVal paper Table 2 (Opus 4.5 (24k thinking budget)) · P-Zero Research
GPT-4o (2024-05-13)0.3TasteVal paper Table 2 (GPT-4o (gpt-4o-2024-05-13)) · P-Zero Research
Kimi K2.50.2TasteVal paper Table 2 (Kimi K2.5 (max, 96k output)) · P-Zero Research
GPT-4 06130.2TasteVal paper Table 2 (GPT-4 (gpt-4-0613)) · P-Zero Research
o1 (2024-12-17)0.2TasteVal paper Table 2 (o1 (high)) · P-Zero Research
Loading Atlas data…