Atlas

Benchmarks

← All benchmarks

ABC-Bench fragment design (SecureBio)

Science

The fragment-design task of SecureBio's Agentic Biosecurity Capabilities Benchmark: design DNA fragments that assemble into a target sequence, using Python and bash, scored by algorithmic checks over 10 runs. SecureBio doesn't state how refusals enter accuracy. GPT-5.4 prints 90.9% with 28.0% refused, more than it could score if refusals counted as wrong, so accuracy appears to cover answered questions only and each model's denominator differs. These scores aren't comparable with other runs of the test, which is why this is a diagnostic.

Benchmark source: Securebio

Top models (higher is better)

ModelScoreSource
Gemini 3 Pro Preview100.0SecureBio Biology Benchmark Dashboard · SecureBio
Sonnet 496.0SecureBio Biology Benchmark Dashboard · SecureBio
Inkling95.7SecureBio Biology Benchmark Dashboard · SecureBio
Gemini 3.1 Pro Preview94.0SecureBio Biology Benchmark Dashboard · SecureBio
DeepSeek-V4-Pro91.1SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.490.9SecureBio Biology Benchmark Dashboard · SecureBio
GPT-5.5 Pro87.0SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K382.5SecureBio Biology Benchmark Dashboard · SecureBio
Beam 1.0 501B A23B77.5SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.676.5SecureBio Biology Benchmark Dashboard · SecureBio
Qwen3.5 397B A17B76.3SecureBio Biology Benchmark Dashboard · SecureBio
Kimi K2.574.8SecureBio Biology Benchmark Dashboard · SecureBio
Nemotron 3 Super 120B A12B74.4SecureBio Biology Benchmark Dashboard · SecureBio
Opus 471.0SecureBio Biology Benchmark Dashboard · SecureBio
Nemotron 3 Nano 30B A3B42.6SecureBio Biology Benchmark Dashboard · SecureBio
Opus 4.819.8SecureBio Biology Benchmark Dashboard · SecureBio
Loading Atlas data…