Atlas

Compare Models

Gemini 4 Carbon vs GPT-6 Astra

Gemini 4 Carbon leads by 0.7 capability points (≈95% interval −2.1 to +3.5): statistically tied · P(higher) ≈ 69%

Wins 52 of 65 shared benchmarks (12 lost, 1 tied)

Capability vs. relative cost
Gemini 4 CarbonGPT-6 AstraClosed weightsOpen weights

Each line runs through one model’s priced reasoning settings, cheapest to most expensive; grey points are other models’ priced settings in the same range. Results whose reasoning effort the source didn’t report are left out wherever a model has named effort levels. Capability and relative cost are the published estimates (relative cost is cost per task as a multiple of GPT-5 (high)); hover a setting, or use the arrow keys, to set it beside the other model’s same setting.

Gemini 4 CarbonvsGPT-6 Astracapability vs. relative costData Nov 15, 2026Village LLM Atlasatlas.village.dev

Benchmark wins52 – 12 · 65 shared, 1 tied

Comparing matching setups only (43 benchmarks excluded) · suites counted once
← Gemini 4 CarbonGPT-6 Astra →

Gemini 4 CarbonvsGPT-6 Astrawins by categoryData Nov 15, 2026Data: Artificial Analysis, Vals AI, Arena and 13 othersVillage LLM Atlasatlas.village.dev

Margins

Each benchmark scaled 0–100% (its declared range, else the field’s range); Δ is GPT-6 Astra minus Gemini 4 Carbon.

TxBench-Antibody-Development V1 (60 evaluations)Science61.132.8−28.3
FoodTruck BenchGames7721857761−25.0
Medical Long Context Reasoning (MLCR-AA, October 2026 methodology)Health & Medicine19.441.7+22.2
Legal Research BenchLegal55.839.4−16.3
APEX-Agents 1.1Professional Work90.475.1−15.3
Harvey LAB (Mercor run, undisclosed ~213-task cohort)Legal23.09.2−13.8
Tax Agent BenchFinance & Accounting76.463.3−13.1
AutomationBench 1.0.6 (Zapier)Agents53.041.4−11.6
OpenWorldEngineer (Mean@8)Code32.844.2+11.4
Vals Finance IndexIndexes67.055.6−11.4
Terminal-Bench 4.0 (Artificial Analysis)Code60.649.5−11.1
HLAB-Vals-1.1Legal17.57.1−10.4
AutomationBench-AA 1.0.6Agents77.868.5−9.3
LMArena Text Arena EloChat & Writing15261474−9.1
Terminal-Bench-Science 0.1Science62.453.3−9.0
τ³-Banking (Mercor run, bm25_grep retrieval)Agents55.746.7−9.0
TxBench Antibody Discovery V1 (100 evaluations)Science65.056.0−9.0
Blueprint-Bench 2Multimodal0.60.5−8.9
GDPval-AA v2.1Professional Work17331538−8.6
RiemannBenchMath80.072.0−8.0
Vals Legal IndexIndexes75.968.4−7.5
Finance Agent v2.1Finance & Accounting67.260.4−6.7
TxBench Preclinical Pharmacology V1 Clean RerunsScience66.059.3−6.7
LMArena Agent Arena Bash ReliabilityAgents-5.27.8+6.5
Artificial Analysis Legal IndexIndexes62.055.6−6.4
FrontierSWE V2 Best@5Code66.773.0+6.3
APEX-Accounting 1.1Finance & Accounting70.764.7−6.0
AA-Briefcase v1.1 EloAgents16111503−5.9
BuseyBench SVGMultimodal7.97.3−5.4
Humanity's Last Exam DiamondGeneral QA69.163.8−5.3
Artificial Analysis Finance & Accounting IndexIndexes62.657.4−5.2
LMArena Agent Arena Praise vs ComplaintAgents41.031.7−4.7
LMArena Agent Arena Net Improvement (Steering Burden)Agents17.014.5−4.6
AA-Omniscience v1.1 IndexIndexes53.544.6−4.5
MKA (Artificial Analysis)Professional Work54.350.2−4.1
TxBench Oligo Discovery V1 (113 evaluations)Science55.851.9−3.8
Excel Modeling Benchmark v1.1Finance & Accounting76.572.7−3.8
Terminal-Bench 4.0Code63.159.6−3.5
Artificial Analysis Engineering IndexIndexes65.361.8−3.5
DAXBench v2Code93.696.8+3.2
Artificial Analysis Intelligence Index v5.0.1Indexes60.056.9−3.2
Artificial Analysis Healthcare & Medical IndexIndexes56.853.7−3.1
Artificial Analysis Strategy & Ops IndexIndexes60.958.0−3.0
MMMU ProMultimodal89.286.4−2.8
SEC-Bench Pro - release-reported cohortCybersecurity88.285.4−2.8
GDP.pdf (Artificial Analysis, All-pass)Professional Work29.632.2+2.6
VIALS-AA (pass@3)Multimodal70.873.3+2.5
Artificial Analysis Intelligence Index v5.0Indexes57.755.3−2.5
Artificial Analysis Economics IndexIndexes59.657.2−2.4
LMArena Agent Arena Confirmed SuccessAgents18.414.0−2.2
LMArena Agent Arena Steering BurdenAgents19.114.8−2.1
Code Migration v1.1 (Vals Index v2.2 subset)Code80.178.0−2.0
CritPt v2 (agentic, avg@5)Science82.384.0+1.7
ChartographyMultimodal72.571.0−1.5
GDPxProfessional Work10.99.6−1.3
VIALS-AA (pass^3)Multimodal64.062.7−1.2
FrontierSWE V2 Worst@5Code56.255.1−1.1
VIALS-AA (average of 3)Multimodal67.368.3+1.0
ARC-AGI-2General QA94.295.0+0.8
AA-LCR v1.1Search79.380.0+0.7
ARC-AGI-3 (Semi-Private)General QA99.198.4−0.6
FrontierCode 2.0 (Artificial Analysis)Code40.640.1−0.4
Artificial Analysis Progress Index v1Indexes351350−0.4
LMArena Agent Arena Tool HallucinationAgents0.51.0+0.2
ARC-AGI-1 Semi-PrivateGeneral QA98.598.50.0

Gemini 4 CarbonvsGPT-6 Astranormalised score marginsData Nov 15, 2026Data: Artificial Analysis, Vals AI, Arena and 13 othersVillage LLM Atlasatlas.village.dev

Win counts use each benchmark’s declared score direction. Represented suite slices and the derived Capability score are excluded from headline totals. Missing or incompatible setups are excluded, never counted as losses.
Loading Atlas data…