← All benchmarks

DeepSWE v1 (Best of up to 3 attempts)

Code · 2026-05-26

This DeepSWE v1 aggregation reports the best whole-benchmark score from up to three attempts on its 113 long-horizon software-engineering tasks. The aggregation qualifier is kept separate from the benchmark's standard pooled pass@1 and pass@4 metrics.

Top models (higher is better)