Atlas

Compare Models

GPT-5.5 vs GPT-5.6 Sol Pro

GPT-5.6 Sol Pro leads by 3.6 capability points (≈95% interval +1.2 to +5.9): a clear lead over GPT-5.5 · P(higher) ≈ 100%

Wins 14 of 23 shared benchmarks (9 lost)

Capability vs. relative cost
GPT-5.5GPT-5.6 Sol ProClosed weightsOpen weights

Each line runs through one model’s priced reasoning settings, cheapest to most expensive; grey points are other models’ priced settings in the same range. Results whose reasoning effort the source didn’t report are left out wherever a model has named effort levels. Capability and relative cost are the published estimates (relative cost is cost per task as a multiple of GPT-5 (high)); hover a setting, or use the arrow keys, to set it beside the other model’s same setting. GPT-5.6 Sol Pro has no setting with a relative cost yet.

GPT-5.5vsGPT-5.6 Sol Procapability vs. relative costData Nov 15, 2026Village LLM Atlasatlas.village.dev

Benchmark wins9 – 14 · 23 shared

Comparing matching setups only (78 benchmarks excluded) · suites counted once
← GPT-5.5GPT-5.6 Sol Pro →

GPT-5.5vsGPT-5.6 Sol Prowins by categoryData Nov 15, 2026Data: Mercor, ForecastBench, MineBench Maintainers and 8 othersVillage LLM Atlasatlas.village.dev

Margins

Each benchmark scaled 0–100% (its declared range, else the field’s range); Δ is GPT-5.6 Sol Pro minus GPT-5.5.

NanoGPT Speedrun Frontier (human record gap closed)Agents8.133.6+34.2
SWE-bench Verified Extended (Mercor held-out)Code39.363.3+24.0
GeneBench-ProScience12.031.5+19.5
BrowseComp (Mercor 130-question subset)Search77.795.7+18.0
SWE-bench MultilingualCode77.794.2+16.5
SWE Atlas - Codebase QnACode45.230.9−14.3
MineBench Conservative RatingGames17722000+13.5
MineBench — Bradley-Terry RatingGames18461994+9.0
FrontierMath Tier 4 (v2) - PrivateMath72.580.5+8.0
SWE Atlas Codebase QnA Extended (Mercor held-out)Code17.324.7+7.4
SWE-bench VerifiedCode78.872.8−6.0
APEX-1 (Mercor, mean score)Professional Work68.473.1+4.7
WeirdML (v2)Science84.989.4+4.5
APEX-AccountingFinance & Accounting48.251.5+3.3
Terminal-Bench 2.1Code84.381.2−3.1
WordleBenchGames97.094.0−3.0
Ruby LLM Benchmarks — Program FixerCode77.675.3−2.3
ForecastBench Preliminary Dataset Brier IndexForecasting63.361.1−2.2
RedlineBenchLegal44.145.8+1.7
APEX-AgentsProfessional Work38.540.0+1.5
Harvey LAB (Mercor run, 1,749 public tasks)Legal4.12.7−1.4
ForecastBench Tournament Overall Brier IndexForecasting67.065.9−1.1
GPQA DiamondGeneral QA95.594.9−0.6

GPT-5.5vsGPT-5.6 Sol Pronormalised score marginsData Nov 15, 2026Data: Mercor, ForecastBench, MineBench Maintainers and 8 othersVillage LLM Atlasatlas.village.dev

Win counts use each benchmark’s declared score direction. Represented suite slices and the derived Capability score are excluded from headline totals. Missing or incompatible setups are excluded, never counted as losses.
Loading Atlas data…