BioMysteryBench - Human Difficult
Science · 2026-07-24
BioMysteryBench Human Difficult contains problems that remain unsolved by independent human experts but have objective ground-truth solutions. This is the revised subset reported from the Claude Opus 5 system card onward, after Anthropic removed 6 problems on external feedback; earlier original-set results use biomysterybench-human-difficult-original-set.
Top models (higher is better)
| Model | Score |
|---|---|
| Gemini 3.8 Flash | 56.5 |
| Claude Opus 5 | 49.4 |
| Claude Fable 5 | 46.5 |
| Gemini 3.7 Flash | 43.5 |
| Opus 4.8 | 42.4 |
| Sonnet 5 | 34.1 |