Atlas

Benchmarks

← All benchmarks

VCT (SecureBio)

Science

SecureBio's own runs of the Virology Capabilities Test, 322 multiple-response virology troubleshooting questions, 221 with images. These are the same questions as vct, whose rows come from xAI model cards, under a different protocol. Evaluated in Inspect with zero-shot prompting, usually over 10 runs. SecureBio doesn't state how refusals enter accuracy. Claude Opus 5.5 prints 61.4% with 79.8% refused, more than it could score if refusals counted as wrong, so accuracy appears to cover answered questions only and each model's denominator differs. These scores aren't comparable with other runs of the test, which is why this is a diagnostic.

Benchmark source: Securebio

Top models (higher is better)

ModelScoreSource
Claude Opus 5.561.4SecureBio Biology Benchmark Dashboard · SecureBio
GPT-6 Astra58.5SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 4 Argon58.4SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.6 Sol54.3SecureBio Biology Benchmark Dashboard · SecureBio
GPT-6 Sol54.0SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.552.3SecureBio Biology Benchmark Dashboard · SecureBio
Claude Opus 551.4SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 551.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.6 Flash50.0SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.449.8SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K3.1 Pro49.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.7 Flash49.3SecureBio Biology Benchmark Dashboard · SecureBio
Grok 4.648.3SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.848.2SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.6 Terra47.2SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.5 Flash47.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.8 Flash46.9SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.646.7SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K346.7SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.745.8SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.1 Pro Preview45.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Pro45.0SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.5 Pro44.6SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.544.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-543.6SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.643.6SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Flash Preview43.4SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3 Pro Preview42.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.142.6SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.242.3SecureBio Biology Benchmark Dashboard · SecureBio
o342.0SecureBio Biology Benchmark Dashboard · SecureBio
Gemma 4 31B IT41.1SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.540.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.2 Pro40.1SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 2.5 Pro38.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5 Mini37.9SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.137.8SecureBio Biology Benchmark Dashboard · SecureBio
o4-mini37.7SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 4.637.5SecureBio Biology Benchmark Dashboard · SecureBio
Inkling37.4SecureBio Biology Benchmark Dashboard · SecureBio
Loading Atlas data…