Atlas

Models

← All models

Llama 3.1 405B Instruct

Meta · 2024-07-23 · 405.9B parameters

Llama 3.1 405B Instruct is the instruction-tuned version of Meta's 405-billion-parameter Llama 3.1 model, released in July 2024. Fine-tuned with supervised fine-tuning and reinforcement learning from human feedback, it is optimized for general-purpose chat, reasoning, multilingual tasks, and tool use with a 128K-token context window.

Benchmark scores

BenchmarkScore
A-Fantasia68.7
A-Fantasia (Valid Attempts with Retries)68.7
A-Fantasia Backwards Spelling100.0
A-Fantasia Chess38.0
A-Fantasia Chess (Valid Attempts with Retries)38.0
A-Fantasia Cube (Valid Attempts with Retries)68.0
A-Fantasia Cube Rotation68.0
A-Fantasia Spelling (Valid Attempts with Retries)100.0
AA-LCR24.3
AA-LCR v1.125.3
AA-Omniscience Index-17.1
Adversarial Robustness1.0
Agentic Tool Use (Chat)40.1
Agentic Tool Use (Enterprise)50.4
AidanBench759
AIME 2025 (Artificial Analysis avg@10)3.0
Arabic875
Arena Text — Business, Management & Financial Ops (No Style Control)1245
Arena Text — Chinese (No Style Control)1242
Arena Text — Creative Writing (No Style Control)1259
Arena Text — English (No Style Control)1312
Arena Text — Entertainment, Sports & Media (No Style Control)1241
Arena Text — Exclude Ties (No Style Control)1213
Arena Text — Exclude Ties (Style Controlled)1286
Arena Text — Expert (No Style Control)1229
Arena Text — French (No Style Control)1279
Arena Text — French (Style Controlled)1342
Arena Text — German (No Style Control)1252
Arena Text — Hard Prompts (No Style Control)1269
Arena Text — Hard Prompts English (No Style Control)1291
Loading Atlas data…