Mistral Small 3.1 24B Instruct 2503

Name: Mistral Small 3.1 24B Instruct 2503
Author: Mistral AI

Mistral AI · 2025-03-17 · 24B parameters

Mistral Small 3.1 24B Instruct 2503 is Mistral AI's March 2025 instruction-tuned multimodal update to Small 3, adding vision understanding to the 24B language model. It extends the context window to 128K tokens and is released under Apache 2.0.

Benchmark scores

Benchmark	Score
AA-Briefcase Elo	325
AA-Briefcase v1.1 Elo	314
AA-LCR	19.7
AA-LCR v1.1	22.3
AA-Omniscience Index	-50.8
AIME 2024 (avg@8)	3.8
AIME 2024-2025	3.5
AIME 2025 (Artificial Analysis avg@10)	3.7
AIME 2025 (avg@8)	3.3
Arena Text — Business, Management & Financial Ops (No Style Control)	1257
Arena Text — Chinese (No Style Control)	1253
Arena Text — Creative Writing (No Style Control)	1252
Arena Text — English (No Style Control)	1295
Arena Text — Entertainment, Sports & Media (No Style Control)	1250
Arena Text — Exclude Ties (No Style Control)	1203
Arena Text — Exclude Ties (Style Controlled)	1239
Arena Text — Expert (No Style Control)	1257
Arena Text — French (No Style Control)	1273
Arena Text — French (Style Controlled)	1308
Arena Text — German (No Style Control)	1266
Arena Text — Hard Prompts (No Style Control)	1278
Arena Text — Hard Prompts English (No Style Control)	1290
Arena Text — Instruction Following (No Style Control)	1263
Arena Text — Japanese (No Style Control)	1208
Arena Text — Korean (No Style Control)	1206
Arena Text — Legal & Government (No Style Control)	1270
Arena Text — Life, Physical & Social Science (No Style Control)	1265
Arena Text — Longer Query (No Style Control)	1298
Arena Text — Medicine & Healthcare (No Style Control)	1267
Arena Text — Multi-turn (No Style Control)	1270