← All benchmarks

Instruction Following

Chat & Writing · 2024-05-29

Score on Scale SEAL's precise instruction-following prompts.

Top models (higher is better)

Model	Score
o1 (2024-12-17)	92.0
DeepSeek-R1	87.8
Gemini 2.0 Flash Experimental	86.6
o1 Preview	86.6
Claude 3.5 Sonnet (June 2024)	86.0
GPT-4o (2024-05-13)	85.3
Llama 3.1 405B Instruct	84.8
Gemini 1.5 Pro Experimental 0827	84.2
GPT-4 0125 Preview	83.2
Mistral Large 2 (Instruct 2407)	82.8
GPT-4o (2024-11-20)	82.5
DeepSeek-V3	82.3
Llama 3.2 90B Vision Instruct	82.1
Llama 3 70B Instruct	81.2
GPT-4o (2024-08-06)	80.2
Opus 3	80.1
Mistral Large 1.0	79.9
GPT-4 Turbo (1106 Preview)	79.5
Gemini 1.5 Pro Preview 0514	79.4