Biopharma Bench V0.1 (Pass@1)
Health & Medicine · 2026-09-22
The share of Biopharma Bench V0.1's 71 pharmaceutical regulatory and CMC tasks on which an agent's deliverable passes every one of the task's frozen expert criteria in its single scored trial, in percent. It is the strict counterpart of the mean score, which gives credit for each criterion passed; the same LLM rubric grader and deterministic checks decide every criterion, against the V0.1 rubrics.
Benchmark source: Raycaster