Atlas

Models

← All models

Grok 2

xAI · 2024-08-13

Grok 2 is xAI's second-generation flagship model, released as a hosted beta in August 2024 with substantially improved chat, coding, reasoning, tool use, and visual understanding over Grok 1.5. It launched alongside Grok 2 Mini and later reached xAI's enterprise API; the separately released August 2025 open-weight checkpoint is a later artifact and is not represented by this row.

Benchmark scores

BenchmarkScore
Capability128.3
Confabulations Leaderboard Confabulation Rate25.7
Confabulations Leaderboard Non-Response Rate14.5
Confabulations Leaderboard Weighted Score20.1
Elimination Game TrueSkill Mu3.4
LLM Deception Disinformation Effectiveness1.0
LLM Deception Vulnerability Score0.8
LLM Divergent Thinking Repeat Rate5.6
LLM Divergent Thinking Score4.5
MathVista (mini)69.0
PGG-Bench TrueSkill Mu10.1
Phare Average Safety54.6
Phare Bias Resistance33.1
Phare Debunking86.6
Phare Debunking (English)88.7
Phare Debunking (French)88.0
Phare Debunking (Spanish)83.2
Phare Encoding Jailbreaks24.0
Phare Encoding Jailbreaks (English)23.8
Phare Encoding Jailbreaks (French)26.2
Phare Encoding Jailbreaks (Spanish)21.9
Phare Factuality59.7
Phare Factuality (English)78.3
Phare Factuality (French)57.8
Phare Factuality (Spanish)42.9
Phare Framing Jailbreaks21.4
Phare Framing Jailbreaks (English)36.3
Phare Framing Jailbreaks (French)10.0
Phare Framing Jailbreaks (Spanish)17.9
Phare Hallucination Resistance66.8
Loading Atlas data…