Qwen 72B
Alibaba · 2023-11-30 · 72.3B parameters
Qwen-72B is the 72-billion-parameter dense base language model of the original Qwen generation, released by Alibaba Cloud on November 30, 2023 and pretrained on over 3 trillion tokens of multilingual text, code and mathematics. It is the base for Qwen-72B-Chat and supports a 32,768-token context.
Benchmark scores
| Benchmark | Score |
|---|---|
| BBH (BIG-Bench Hard) | 67.7 |
| C-Eval | 83.3 |
| Capability | 108.0 |
| CMMLU | 83.6 |
| GSM8K | 78.9 |
| HumanEval | 35.4 |
| MATH | 35.2 |
| MBPP | 52.2 |
| MMLU | 77.4 |