Atlas

Benchmarks

← All benchmarks

VCT text-only (SecureBio)

Science

SecureBio's own runs of the 101 text-only questions of the Virology Capabilities Test, for models that can't process images. Evaluated in Inspect with zero-shot prompting, usually over 10 runs. SecureBio doesn't state how refusals enter accuracy. Claude Sonnet 4.5 prints 46.1% with 58.8% refused, more than it could score if refusals counted as wrong, so accuracy appears to cover answered questions only and each model's denominator differs. These scores aren't comparable with other runs of the test, which is why this is a diagnostic.

Benchmark source: Securebio

Top models (higher is better)

ModelScoreSource
GPT-5.557.8SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 4 Argon57.7SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 556.3SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.6 Terra56.1SecureBio Biology Benchmark Dashboard · SecureBio
Claude Opus 555.4SecureBio Biology Benchmark Dashboard · SecureBio
Grok 4.655.4SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K355.4SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.454.7SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K3.1 Pro53.8SecureBio Biology Benchmark Dashboard · SecureBio
GPT-552.7SecureBio Biology Benchmark Dashboard · SecureBio
GLM-5.251.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.251.4SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.651.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Pro50.9SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.650.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.850.1SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3.8 2.4T A95B50.1SecureBio Biology Benchmark Dashboard · SecureBio
Beam 1.0 501B A23B50.0SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3.7-Max (source unspecified)48.8SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.2 Pro48.5SecureBio Biology Benchmark Dashboard · SecureBio
o348.4SecureBio Biology Benchmark Dashboard · SecureBio
o4-mini48.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.548.0SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.1 Pro Preview47.6SecureBio Biology Benchmark Dashboard · SecureBio
GLM-5.347.5SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.147.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.6 Flash47.4SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.147.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.7 Flash47.3SecureBio Biology Benchmark Dashboard · SecureBio
Inkling46.8SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.546.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Flash Preview44.9SecureBio Biology Benchmark Dashboard · SecureBio
Grok 444.7SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Mini44.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.5 Flash44.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.744.0SecureBio Biology Benchmark Dashboard · SecureBio
Claude 3.5 Sonnet (Oct 2024)43.5SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.643.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.8 Flash43.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Pro Preview43.0SecureBio Biology Benchmark Dashboard · SecureBio
Loading Atlas data…