CCPM
General QA · 2021-06-03
CCPM (Chinese Classical Poetry Matching) gives a modern-Chinese description and asks which of four candidate lines of classical Chinese poetry it describes. Scores are accuracy. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| DeepSeek-V3-Base | 92.0 |
| DeepSeek LLM 67B Base | 88.5 |
| Qwen2.5 72B | 88.5 |
| Qwen1.5 72B | 88.1 |
| DeepSeek LLM 67B Chat | 84.9 |
| Llama 3.1 405B | 78.6 |
| DeepSeek LLM 7B Base | 76.9 |
| DeepSeek LLM 7B Chat | 76.5 |
| Llama 3 70B | 68.1 |
| Mixtral 8x22B | 61.0 |