Benchmarks
331 sources · 1,258 models × 2,980 benchmarks · 155,643 scoresThe share of Longtail-SWE's 202 issue-resolution tasks solved in at least one of three attempts, in the authors' SWE-agent-like scaffold.
No signal or difficulty estimate. Too few models have been measured on this benchmark to estimate its difficulty.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Claude Opus 5.5 | high · SWE-rebench swelike scaffold; 1M context | 89.1 | |
| 2 | GPT-5.6 Sol | high · SWE-rebench swelike scaffold; 1M context | 87.1 | |
| 3 | GPT-5.6 Luna | x-high · SWE-rebench swelike scaffold; 1M context | 84.2 | |
| 4 | GPT-6.1 Sol | high · SWE-rebench swelike scaffold; 1M context | 82.2 | |
| 5 | Kimi K3 | max · SWE-rebench swelike scaffold; 262K context | 76.2 | |
| 6 | GLM-5.3 Flash | not reported · SWE-rebench swelike scaffold; 262K context | 69.8 | |
| 7 | Qwen3.6 27B | thinking · SWE-rebench swelike scaffold; 262K context | 23.8 |