RACE-Middle
General QA · 2017-04-15
RACE-Middle is the middle-school portion of RACE, a four-option multiple-choice reading-comprehension dataset built from English exams for Chinese students. Scores are accuracy on its 1,436-question test split.
Top models (higher is better)
| Model | Score |
|---|---|
| Llama 3.1 405B | 74.2 |
| Mixtral 8x22B | 73.3 |
| Llama 3 70B | 73.3 |
| DeepSeek-V2 | 73.1 |
| DeepSeek LLM 67B Chat | 70.9 |
| DeepSeek LLM 67B Base | 69.9 |
| Qwen2.5 72B | 68.1 |
| PaLM 540B | 68.1 |
| LLaMA 65B | 67.9 |
| DeepSeek-V3-Base | 67.1 |
| DeepSeek LLM 7B Chat | 65.2 |
| DeepSeekMoE 16B Chat | 64.8 |
| PaLM 62B | 64.3 |
| LLaMA 33B | 64.1 |
| Qwen1.5 72B | 63.4 |
| DeepSeek LLM 7B Base | 63.2 |
| DeepSeekMoE 16B Base | 61.9 |
| LLaMA-13B | 61.6 |
| LLaMA 7B | 61.1 |