Atlas

Models

← All models

Grok 2 1212

xAI · 2024-12-12

Grok 2 1212 is xAI's December 12, 2024 update to Grok 2 with improved accuracy, instruction following, and multilingual capabilities.

Benchmark scores

BenchmarkScore
AIME 2024 (avg@8)19.6
AIME 2024-202515.2
AIME 2025 (avg@8)10.8
Artificial Analysis Progress Index v1161
BuzzBench51.8
Capability126.2
CorpFin v251.1
CorpFin v2 - Exact Pages57.2
CorpFin v2 - Max Fitting Context45.2
CorpFin v2 - Shared Max Context50.9
DTBench65.2
Epoch Capabilities Index (ECI)130
GPQA Diamond52.0
GPQA Diamond (Artificial Analysis avg@5)51.0
GPQA Diamond (Vals protocol average)50.8
Humanity's Last Exam (Text-Only)3.1
LiveCodeBench (Artificial Analysis)26.7
LiveCodeBench (Vals AI public dataset)38.7
LiveCodeBench (Vals Public) - Easy85.7
LiveCodeBench (Vals Public) - Hard3.4
LiveCodeBench (Vals Public) - Medium26.9
MATH Level 563.5
MATH-50078.4
MATH-500 (Artificial Analysis source)77.8
MedQA Demographic Bias (Vals)92.3
MedQA Demographic Bias (Vals) - Asian92.0
MedQA Demographic Bias (Vals) - Black92.2
MedQA Demographic Bias (Vals) - Hispanic91.7
MedQA Demographic Bias (Vals) - Indigenous91.6
MedQA Demographic Bias (Vals) - Unbiased94.0
Loading Atlas data…