Atlas

Benchmarks

← All benchmarks

MT-Bench - release-reported (non-standard or unstated judge)

Chat & Writing

MT-Bench scores (80 two-turn questions, 1-10 judge scale) reported by a model release that grades with a judge other than the official GPT-4 setup (for example GPT-4o as judge, or a 'dev' variant) or does not state the judge. Judge choice shifts the scale, so these values are kept as a diagnostic apart from official MT-Bench.

Top models (higher is better)

ModelScore
Mistral Small 3 24B Instruct 25018.3
GPT-4o Mini8.3
Ministral 8B Instruct 24108.3
Qwen2.5 Instruct 32B8.3
Ministral 3B8.1
Llama 3.3 70B Instruct8.0
Gemma 2 27B IT7.9
Mistral NeMo Instruct 24077.8
Pixtral 12B7.7
Gemma 2 9B IT7.6
Gemma 2 2B IT7.5
Llama 3.1 8B Instruct7.5
Llama 3.2 3B Instruct7.2
Llama 3 8B Instruct6.8
Mistral 7B Instruct v0.36.7
Qwen2 VL 7B Instruct6.4
Phi-3.5-vision-instruct6.3
Loading Atlas data…