RACE-High
General QA · 2017-04-15
RACE-High is the high-school portion of RACE, a four-option multiple-choice reading-comprehension dataset built from English exams for Chinese students. Its passages and questions are harder than RACE-Middle; scores are accuracy on its 3,498-question test split.
Top models (higher is better)
| Model | Score |
|---|---|
| Opus 3 | 92.9 |
| Claude 1.3 | 88.8 |
| Claude 3 Sonnet | 88.8 |
| Claude 2 | 88.3 |
| Claude 3 Haiku | 87.0 |
| Claude Instant 1.1 | 85.5 |
| Llama 3 70B | 57.9 |
| Llama 3.1 405B | 56.8 |
| Mixtral 8x22B | 56.7 |
| DeepSeek LLM 67B Chat | 56.0 |
| LLaMA 65B | 51.6 |
| DeepSeek-V3-Base | 51.3 |
| DeepSeek LLM 7B Chat | 50.8 |
| DeepSeek LLM 67B Base | 50.7 |
| DeepSeekMoE 16B Chat | 50.6 |
| Qwen2.5 72B | 50.3 |
| PaLM 540B | 49.1 |
| LLaMA 33B | 48.3 |
| PaLM 62B | 47.5 |
| LLaMA-13B | 47.2 |
| Qwen1.5 72B | 47.0 |
| LLaMA 7B | 46.9 |
| DeepSeek LLM 7B Base | 46.5 |
| DeepSeekMoE 16B Base | 46.4 |