Atlas

Compare Models

GPT-6.2 Sol vs Grok 4.6

GPT-6.2 Sol leads by 7.2 capability points (≈95% interval +4.8 to +9.6): a clear lead over Grok 4.6 · P(higher) ≈ 100%

Wins 37 of 49 shared benchmarks (11 lost, 1 tied)

Capability vs. relative cost
GPT-6.2 SolGrok 4.6Closed weightsOpen weights

Benchmark wins37 – 11 · 49 shared, 1 tied

Comparing matching setups only (6 benchmarks excluded) · suites counted once
← GPT-6.2 SolGrok 4.6 →
Data: Artificial Analysis, Vals AI, Arena and 11 othersatlas.village.dev

Margins

Each benchmark scaled 0–100% (its declared range, else the field’s range); Δ is Grok 4.6 minus GPT-6.2 Sol.

Terminal-Bench-Science 0.1Science › Multidisciplinary67.66.2−61.4
ChartographyPerception & media › Documents & charts75.120.5−54.6
Gray Swan IPI Attack Success (k=15)Safety & alignment2.351.8−49.5
Terminal-Bench Science 0.1 (Vals)Science › Multidisciplinary58.611.4−47.1
Terminal-Bench 4.0Software › Software engineering60.617.2−43.4
Humanity's Last Exam DiamondKnowledge & reasoning › General knowledge64.021.5−42.5
AA-PersonalityBench Imagination indexLanguage & writing › Style & personality60.120.0−40.4
ARC-AGI-3 (Semi-Private)Games40.12.1−38.0
Terminal-Bench 4.0 (Artificial Analysis)Software › Software engineering58.621.2−37.4
AA-PersonalityBench Organization indexLanguage & writing › Style & personality45.714.3−31.7
DeepsecBench — Revalidated V1 (233 issues)Software › Cybersecurity47.316.1−31.3
EnterpriseBench: CoreCraftTool & computer use › Customer service & operations36.465.6+29.2
AA-PersonalityBench Warmth indexLanguage & writing › Style & personality60.131.5−28.9
Artificial Analysis Intelligence Index v5.0.1Composite indexes57.331.0−26.2
EnterpriseOps-Gym-AATool & computer use › Customer service & operations23.448.3+25.0
Blueprint-Bench 2Perception & media › Spatial & visual reasoning0.60.3−23.8
LMArena Agent Arena Net Improvement (Steering Burden)Tool & computer use › General agents11.3-0.6−23.2
FrontierCode 2.0 (Artificial Analysis)Software › Software engineering42.819.8−23.0
AA-PersonalityBench Slop indexLanguage & writing › Style & personality15.435.3+20.1
Vals Science IndexScience › Multidisciplinary57.838.1−19.7
Medical Long Context Reasoning (MLCR-AA, October 2026 methodology)Health & medicine37.218.3−18.9
ARC-AGI-2Knowledge & reasoning › Abstract reasoning85.867.1−18.7
LiveBench 2.0 (2026-11-06 release)Composite indexes80.363.5−16.8
CritPt v2 (agentic, avg@5)Science › Physical sciences78.362.3−16.0
AA-PersonalityBench Transparency indexLanguage & writing › Style & personality56.971.4+14.7
HealthBench Professional (Length-Adjusted)Health & medicine65.951.7−14.2
LMArena Agent Arena Praise vs ComplaintTool & computer use › General agents23.3-3.5−13.4
AA-PersonalityBench Conviction indexLanguage & writing › Style & personality79.292.4+13.3
GDP.pdf (Artificial Analysis, All-pass)Professional › General knowledge work30.017.8−12.2
DAYJOB: Finance (October 2026 rescoring)Professional › Finance, accounting & tax32.821.0−11.8
Vibe Code Bench v1.1Software › Frontend & design87.676.2−11.4
AA-AnalystAgent (pass^5)Professional › General knowledge work52.541.3−11.2
Legal Research BenchProfessional › Legal37.048.1+11.1
ARC-AGI-1 Semi-PrivateKnowledge & reasoning › Abstract reasoning97.587.5−10.0
AA-PersonalityBench Expressiveness indexLanguage & writing › Style & personality55.363.8+8.6
Tax Agent BenchProfessional › Finance, accounting & tax62.971.4+8.5
LMArena Agent Arena Steering BurdenTool & computer use › General agents13.4-2.5−7.9
AA-Omniscience v1.1 IndexKnowledge & reasoning › General knowledge40.424.9−7.8
AA-PersonalityBench Informativeness indexLanguage & writing › Style & personality37.744.8+7.1
LMArena Agent Arena Confirmed SuccessTool & computer use › General agents10.9-2.5−6.7
MysteryMechanismMath36.930.6−6.3
SimpleBenchKnowledge & reasoning › General knowledge69.975.9+6.0
BioMysteryBench (Vals Terminus 2)Science › Life sciences77.872.2−5.6
AutomationBench-AA 1.0.6Tool & computer use › Customer service & operations71.367.0−4.3
TxBench Preclinical Pharmacology V1 Clean RerunsScience › Life sciences65.361.7−3.7
LMArena Agent Arena Bash ReliabilityTool & computer use › General agents4.39.1+2.4
DAYJOB: Healthcare (October 2026 rescoring)Health & medicine17.214.8−2.4
AA-Briefcase v1.1 EloProfessional › General knowledge work15801540−2.2
LMArena Agent Arena Tool HallucinationTool & computer use › Tool calling1.21.20.0
Data: Artificial Analysis, Vals AI, Arena and 11 othersatlas.village.dev
Win counts use each benchmark’s declared score direction. Represented suite slices and the derived Capability score are excluded from headline totals. Missing or incompatible setups are excluded, never counted as losses.
Loading Atlas data…