Atlas

Benchmarks

← All benchmarks

HLE-Bio (SecureBio)

Science

SecureBio's own runs of the 275-question public biology and medicine subset of Humanity's Last Exam. Evaluated in Inspect with zero-shot prompting, usually over 10 runs. SecureBio doesn't state how refusals enter accuracy. Refusals reach 30.8% here, and on other tests of the dashboard printed accuracy exceeds what counting refusals as wrong allows, so accuracy appears to cover answered questions only and each model's denominator differs. These scores aren't comparable with other runs of the test, which is why this is a diagnostic.

Benchmark source: Securebio

Top models (higher is better)

ModelScoreSource
Claude Opus 545.9SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.1 Pro Preview42.2SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Pro Preview38.2SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.5 Flash38.0SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.6 Terra38.0SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.837.6SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Flash Preview37.0SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.7 Flash36.2SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.6 Flash33.7SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Pro31.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.431.7SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.531.4SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.530.5SecureBio Biology Benchmark Dashboard · SecureBio
GPT-529.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.129.6SecureBio Biology Benchmark Dashboard · SecureBio
Grok 4.629.2SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 528.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Mini25.7SecureBio Biology Benchmark Dashboard · SecureBio
Muse Glimmer 30B22.8SecureBio Biology Benchmark Dashboard · SecureBio
o322.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.221.7SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.521.4SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3.8 27B21.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.119.3SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 2.5 Pro18.8SecureBio Biology Benchmark Dashboard · SecureBio
o4-mini18.6SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.518.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 417.8SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3.6 27B17.2SecureBio Biology Benchmark Dashboard · SecureBio
Gemma 4 31B IT16.9SecureBio Biology Benchmark Dashboard · SecureBio
o1 (2024-12-17)16.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Nano15.6SecureBio Biology Benchmark Dashboard · SecureBio
Haiku 4.515.2SecureBio Biology Benchmark Dashboard · SecureBio
GPT-4.114.3SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 413.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 2.5 Flash13.2SecureBio Biology Benchmark Dashboard · SecureBio
GPT-4.1 Mini12.0SecureBio Biology Benchmark Dashboard · SecureBio
Mistral Medium 3.510.8SecureBio Biology Benchmark Dashboard · SecureBio
GPT-4.1 Nano9.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-4o (2024-11-20)9.6SecureBio Biology Benchmark Dashboard · SecureBio
Loading Atlas data…