← All benchmarks

dfbench Detection Recall

Cybersecurity · 2026-08-19

depthfirst's held-out defensive security benchmark, built from real vulnerabilities in open-source projects. An agent audits a repository scope in depthfirst's internal harness with network access disabled, and detection recall is the share of the scope's known vulnerabilities it finds. The August 19, 2026 post describes 253 examples and 910 vulnerabilities, and the page says the dataset will keep evolving. depthfirst ran these evaluations under providers' trusted access programs without saying which rows did, so scores aren't established as the stock models' and stay diagnostic.

Benchmark source: Depthfirst

Top models (higher is better)