Atlas

Models

← All models

Claude 3.5 Sonnet (Oct 2024)

Anthropic · 2024-10-22

Claude 3.5 Sonnet (October 2024) is Anthropic's upgraded Claude 3.5 Sonnet, improving reasoning, coding, and visual understanding and introducing the experimental computer-use capability.

Benchmark scores

BenchmarkScore
A-Fantasia46.0
A-Fantasia (Valid Attempts with Retries)46.0
A-Fantasia Backwards Spelling34.0
A-Fantasia Chess35.0
A-Fantasia Chess (Valid Attempts with Retries)35.0
A-Fantasia Cube (Valid Attempts with Retries)69.0
A-Fantasia Cube Rotation69.0
A-Fantasia Spelling (Valid Attempts with Retries)34.0
AidanBench2673
Aider Polyglot51.6
AIME 202416.0
AIME 2024 (avg@8)15.4
AIME 2024-202510.0
AIME 2025 (avg@8)4.6
AIME 2025 (MathArena repeated-run mean)3.3
Arena Text — Business, Management & Financial Ops (No Style Control)1255
Arena Text — Chinese (No Style Control)1272
Arena Text — Creative Writing (No Style Control)1292
Arena Text — English (No Style Control)1307
Arena Text — Entertainment, Sports & Media (No Style Control)1279
Arena Text — Exclude Ties (No Style Control)1236
Arena Text — Exclude Ties (Style Controlled)1346
Arena Text — Expert (No Style Control)1265
Arena Text — French (No Style Control)1305
Arena Text — French (Style Controlled)1394
Arena Text — German (No Style Control)1297
Arena Text — Hard Prompts (No Style Control)1305
Arena Text — Hard Prompts English (No Style Control)1311
Arena Text — Instruction Following (No Style Control)1297
Arena Text — Japanese (No Style Control)1234
Loading Atlas data…