Atlas

Benchmarks

MedChemBench (ranking and candidate selection)

MedChemBench's ranking and candidate selection component (Table S2 of the paper): on the 86 of 99 tasks with ranking and candidate selection criteria, the share of ranking and selection points earned: pairwise order credit for full rankings (ties earn half, so a random order expects 0.5) and Jaccard similarity for selected sets, averaged over ten responses per task and then equally over those tasks. It is normalized within the component rather than being an additive share of the overall score, so it is a diagnostic of medchembench. OpenAI's MedChemBench (November 20, 2026) poses 99 medicinal-chemistry problems built from 117 recent papers and patents (median publication year 2025), each giving the biological context, compound structures and experimental evidence (structure drawings, assay tables, plots, protein–ligand views) up to a decision point in a drug program; a model answers each in one turn, without tools.

Models
11
Top score
52.8
Leader
GPT-5.5
Updated
Nov 20, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
11 dated models · 3 frontier modelsClosed weightsOpen weights
Data: OpenAIatlas.village.dev

MedChemBench (ranking and candidate selection) leaderboard

Related benchmarks

Loading Atlas data…