MMLU Pro - Health
General QA · 2024-06-03
The Health split of MMLU Pro. Its guessing floor averages the reciprocal option count across all 818 subject questions in official dataset revision b189ec765aa7ed75c8acfea42df31fdae71f97be. This component remains distinct from the parent aggregate.
Top models (higher is better)
| Model | Score |
|---|---|
| Claude Fable 5.1 | 86.7 |
| Gemini 3.1 Pro Preview | 86.4 |
| Opus 4.8 | 85.1 |
| Opus 4.1 | 85.0 |
| Gemini 3.7 Flash | 84.7 |
| Opus 4.5 | 84.6 |
| Opus 4.6 | 84.6 |
| Gemini 3.6 Flash | 84.6 |
| Gemini 3.8 Flash | 84.5 |
| GPT-5.5 | 84.4 |
| Grok 4.6 | 84.4 |
| Qwen3.7-Max (source unspecified) | 84.4 |
| GPT-5.6 Sol | 84.1 |
| Opus 4 | 84.0 |
| Grok 4.5 | 84.0 |
| Qwen3.8-Max | 84.0 |
| MiniMax M2.1 | 83.7 |
| Gemini 3.5 Flash | 83.6 |
| Gemini 3 Pro Preview | 83.6 |
| Muse Spark 1.1 | 83.4 |
| GPT-5.6 Terra | 82.8 |
| Gemini 3 Flash Preview | 82.6 |
| Grok 4.3 | 82.6 |
| Opus 4.7 | 82.4 |
| Sonnet 4.6 | 82.4 |
| DeepSeek-V4-Pro | 82.4 |
| GPT-5.4 | 82.4 |
| Sonnet 5 | 82.3 |
| Sonnet 4.5 | 82.0 |
| Kimi K3 | 82.0 |
| Muse Spark 1.2 | 82.0 |
| GLM-5.3 | 81.8 |
| Grok 4 | 81.7 |
| GLM-5.1 | 81.5 |
| GLM-5.2 | 81.4 |
| GPT-5.6 Luna | 81.4 |
| DeepSeek V4 Pro 0813 | 81.3 |
| GPT-5.2 | 81.2 |
| GLM-5.3 Flash | 80.9 |
| GPT-5.1 | 80.9 |