Atlas

Benchmarks

← All benchmarks

LAB-Bench ProtocolQA (SecureBio)

Science

SecureBio's own runs of LAB-Bench ProtocolQA. These are the same 108 public questions as lab-bench-protocolqa under a different protocol. Evaluated in Inspect with zero-shot prompting, usually over 10 runs. SecureBio doesn't state how refusals enter accuracy. Gemini 4 Argon prints 95.9% with 6.6% refused, more than it could score if refusals counted as wrong, so accuracy appears to cover answered questions only and each model's denominator differs. These scores aren't comparable with other runs of the test, which is why this is a diagnostic.

Benchmark source: Securebio

Top models (higher is better)

ModelScoreSource
Gemini 4 Argon95.9SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.7 Flash86.8SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.8 Flash84.0SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Pro Preview81.4SecureBio Biology Benchmark Dashboard · SecureBio
Claude Opus 581.1SecureBio Biology Benchmark Dashboard · SecureBio
Grok 480.9SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.5 Flash79.8SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.6 Flash79.7SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.279.5SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 579.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.579.0SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Flash Preview78.5SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.478.3SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K3.1 Pro78.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.577.9SecureBio Biology Benchmark Dashboard · SecureBio
Inkling77.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.6 Terra77.0SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.876.9SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.776.7SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.576.7SecureBio Biology Benchmark Dashboard · SecureBio
Grok 4.1 Fast76.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 2.5 Pro Preview 05-0676.0SecureBio Biology Benchmark Dashboard · SecureBio
o376.0SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3-Next-80B-A3B-Thinking76.0SecureBio Biology Benchmark Dashboard · SecureBio
Muse Glimmer 30B75.8SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 2.5 Pro75.6SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.675.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 475.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.175.0SecureBio Biology Benchmark Dashboard · SecureBio
DeepSeek-R1-052874.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Mini74.2SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Pro73.9SecureBio Biology Benchmark Dashboard · SecureBio
o1 (2024-12-17)73.9SecureBio Biology Benchmark Dashboard · SecureBio
Beam 1.0 501B A23B73.8SecureBio Biology Benchmark Dashboard · SecureBio
GPT-573.8SecureBio Biology Benchmark Dashboard · SecureBio
Grok 4 Fast73.8SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3 235B A22B Thinking 250773.8SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.673.6SecureBio Biology Benchmark Dashboard · SecureBio
o4-mini73.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemma 4 31B IT73.0SecureBio Biology Benchmark Dashboard · SecureBio
Loading Atlas data…