Atlas

Benchmarks

Longtail-SWE (All-3)

Longtail Swe

The share of Longtail-SWE's 202 issue-resolution tasks solved in all three attempts, a measure of consistency, in the authors' SWE-agent-like scaffold.

Models
7
Top score
73.8
Leader
Claude Opus 5.5
Updated
Nov 6, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Too few models have been measured on this benchmark to estimate its difficulty.

Organizations
7 dated models · 3 frontier modelsClosed weightsOpen weights
Data: Nebiusatlas.village.dev
#ModelSettingScoreSource
1Claude Opus 5.5high · SWE-rebench swelike scaffold; 1M context
73.8
2GPT-6.1 Solhigh · SWE-rebench swelike scaffold; 1M context
73.3
3GPT-5.6 Solhigh · SWE-rebench swelike scaffold; 1M context
63.4
4GPT-5.6 Lunax-high · SWE-rebench swelike scaffold; 1M context
56.9
5Kimi K3max · SWE-rebench swelike scaffold; 262K context
48.5
6GLM-5.3 Flashnot reported · SWE-rebench swelike scaffold; 262K context
23.8
7Qwen3.6 27Bthinking · SWE-rebench swelike scaffold; 262K context
9.4
Loading Atlas data…