CNMO 2024
Math
CNMO 2024 is the problem set of the 2024 Chinese National High School Mathematics Olympiad, used by DeepSeek as an olympiad-level answer-matching math benchmark alongside AIME. Scores are the share of problems answered correctly, which DeepSeek reports as pass@1 averaged over repeated samples. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| DeepSeek-R1-Zero | 88.1 |
| DeepSeek-R1-0528 | 86.9 |
| DeepSeek-R1 | 78.8 |
| o1-mini | 67.6 |
| DeepSeek-V3 | 43.2 |
| Qwen2.5 72B Instruct | 15.9 |
| Claude 3.5 Sonnet (Oct 2024) | 13.1 |
| GPT-4o (2024-05-13) | 10.8 |
| DeepSeek-V2.5 | 10.8 |
| Llama 3.1 405B Instruct | 6.8 |
| DeepSeek-V2-Chat | 2.8 |