Atlas

Compare Models

GPT-6.2 Astra vs Grok 4.6

GPT-6.2 Astra leads by 8.8 capability points (≈95% interval +6.4 to +11.2): a clear lead over Grok 4.6 · P(higher) ≈ 100%

Wins 51 of 61 shared benchmarks (9 lost, 1 tied)

Capability vs. relative cost
GPT-6.2 AstraGrok 4.6Closed weightsOpen weights

Benchmark wins51 – 9 · 61 shared, 1 tied

Comparing matching setups only (10 benchmarks excluded) · suites counted once
← GPT-6.2 AstraGrok 4.6 →
Data: Artificial Analysis, Epoch AI, Vals AI and 13 othersatlas.village.dev

Margins

Each benchmark scaled 0–100% (its declared range, else the field’s range); Δ is Grok 4.6 minus GPT-6.2 Astra.

Terminal-Bench-Science 0.1Science › Multidisciplinary78.62.9−75.7
FrontierMath Tier 4 (v2) - PrivateMath100.031.7−68.3
Mystery Game PuzzlesGames95.034.0−61.0
Terminal-Bench Science 0.1 (Vals)Science › Multidisciplinary71.411.4−60.0
ARC-AGI-3 (Semi-Private)Games56.52.1−54.4
Humanity's Last Exam DiamondKnowledge & reasoning › General knowledge72.221.5−50.7
Gray Swan IPI Attack Success (k=15)Safety & alignment2.451.8−49.4
Furniture Assembly BenchmarkPerception & media › Spatial & visual reasoning89.240.0−49.2
Terminal-Bench 4.0 (Artificial Analysis)Software › Software engineering64.117.2−47.0
Chartography (November 2026 rescoring)Perception & media › Documents & charts90.744.4−46.3
Terminal-Bench 4.0Software › Software engineering63.117.2−46.0
DeepsecBench — Revalidated V1 (233 issues)Software › Cybersecurity61.216.1−45.1
Chess Puzzles (task version 2.0)Games78.033.0−45.0
AA-PersonalityBench Imagination indexLanguage & writing › Style & personality63.320.0−43.7
AA-PersonalityBench Warmth indexLanguage & writing › Style & personality68.131.5−37.0
Artificial Analysis Intelligence Index v5.0.1Composite indexes62.131.0−31.1
AA-PersonalityBench Transparency indexLanguage & writing › Style & personality40.971.4+30.8
LMArena Agent Arena Net Improvement (Steering Burden)Tool & computer use › General agents15.2-0.6−30.8
Vals Science IndexScience › Multidisciplinary68.438.1−30.3
SimpleQA Verified (Epoch anti-abstention)Knowledge & reasoning › General knowledge78.549.3−29.2
FrontierCode 2.0 (Artificial Analysis)Software › Software engineering49.019.8−29.2
ARC-AGI-2Knowledge & reasoning › Abstract reasoning95.867.1−28.7
Blueprint-Bench 2Perception & media › Spatial & visual reasoning0.60.3−28.2
AA-PersonalityBench Slop indexLanguage & writing › Style & personality7.435.3+28.2
MirrorCode (ML, +Private, 2L)Software › Software engineering67.841.1−26.7
FrontierMath Tiers 1-3 (v2) - PrivateMath92.666.0−26.7
DAYJOB: Finance (October 2026 rescoring)Professional › Finance, accounting & tax45.821.0−24.8
EnterpriseOps-Gym-AATool & computer use › Customer service & operations25.248.3+23.2
MysteryMechanismMath53.230.6−22.5
EnterpriseBench: CoreCraftTool & computer use › Customer service & operations43.665.6+22.0
LiveBench 2.0 (2026-11-06 release)Composite indexes84.963.5−21.4
AA-PersonalityBench Conviction indexLanguage & writing › Style & personality71.392.4+21.3
Medical Long Context Reasoning (MLCR-AA, October 2026 methodology)Health & medicine39.418.3−21.1
CritPt v2 (agentic, avg@5)Science › Physical sciences83.162.3−20.9
LMArena Agent Arena Praise vs ComplaintTool & computer use › General agents37.0-3.5−20.3
AA-AnalystAgent (pass^5)Professional › General knowledge work61.341.3−20.0
DAYJOB: Healthcare (October 2026 rescoring)Health & medicine34.414.8−19.6
HealthBench Professional (Length-Adjusted)Health & medicine66.351.7−14.6
Vibe Code Bench v1.1Software › Frontend & design89.976.2−13.7
AA-PersonalityBench Informativeness indexLanguage & writing › Style & personality31.344.8+13.6
Tax Agent BenchProfessional › Finance, accounting & tax57.971.4+13.5
LLM Debate BenchmarkLanguage & writing › Language & wordplay16731585−12.6
AA-Omniscience v1.1 IndexKnowledge & reasoning › General knowledge50.024.9−12.6
Epoch Capabilities Index (ECI)Composite indexes173158−12.0
GDP.pdf (Artificial Analysis, All-pass)Professional › General knowledge work29.817.8−12.0
ARC-AGI-1 Semi-PrivateKnowledge & reasoning › Abstract reasoning98.587.5−11.0
AutomationBench-AA 1.0.6Tool & computer use › Customer service & operations77.267.0−10.3
MMMU ProKnowledge & reasoning › General knowledge89.580.5−9.0
BioMysteryBench (Vals Terminus 2)Science › Life sciences80.772.2−8.5
LMArena Agent Arena Steering BurdenTool & computer use › General agents14.0-2.5−8.2
AA-PersonalityBench Organization indexLanguage & writing › Style & personality21.814.3−7.5
LMArena Agent Arena Confirmed SuccessTool & computer use › General agents12.4-2.5−7.5
TxBench Preclinical Pharmacology V1 Clean RerunsScience › Life sciences68.061.7−6.3
Legal Research BenchProfessional › Legal42.848.1+5.3
AA-Briefcase v1.1 EloProfessional › General knowledge work15941540−3.0
GPQA DiamondScience › Multidisciplinary96.894.0−2.8
AA-PersonalityBench Expressiveness indexLanguage & writing › Style & personality66.563.8−2.7
SimpleBenchKnowledge & reasoning › General knowledge77.375.9−1.4
OTIS Mock AIME 2024-2025Math100.099.2−0.8
LMArena Agent Arena Bash ReliabilityTool & computer use › General agents7.79.1+0.7
LMArena Agent Arena Tool HallucinationTool & computer use › Tool calling1.21.20.0
Data: Artificial Analysis, Epoch AI, Vals AI and 13 othersatlas.village.dev
Win counts use each benchmark’s declared score direction. Represented suite slices and the derived Capability score are excluded from headline totals. Missing or incompatible setups are excluded, never counted as losses.
Loading Atlas data…