Qwen1.5 4B
Alibaba · 2024-02-04 · 4B parameters
Qwen1.5-4B is a base (pretrained) checkpoint of Alibaba's Qwen1.5 family, announced on February 4, 2024. It is a dense decoder-only Transformer with 3,950,369,280 parameters and a 32,768-token context window; Qwen1.5-4B-Chat is its aligned counterpart.
Benchmark scores
| Benchmark | Score |
|---|---|
| BBH (BIG-Bench Hard) | 32.5 |
| C-Eval | 67.6 |
| Capability | 86.5 |
| CMMLU | 66.7 |
| GSM8K | 57.0 |
| HumanEval | 25.6 |
| MATH | 10.0 |
| MBPP | 29.2 |
| MMLU | 56.1 |