Qwen2.5 1.5B Instruct
Alibaba · 2024-09-19 · 1.5B parameters
Qwen2.5-1.5B-Instruct is the instruction-tuned version of Alibaba's Qwen2.5-1.5B, released on September 19, 2024. It is a dense decoder-only Transformer with 1,543,714,304 parameters, grouped-query attention and tied embeddings, with a 32,768-token context window and up to 8,192 generated tokens.
Benchmark scores
| Benchmark | Score |
|---|---|
| Capability | 99.2 |
| GPQA - release-reported, subset unspecified | 29.8 |
| GSM8K | 73.2 |
| HumanEval | 61.6 |
| IFEval (prompt-level strict accuracy) | 42.5 |
| LiveBench 2024-08-31 | 18.8 |
| LiveCodeBench - May 2023 to September 2024 | 14.8 |
| MATH | 55.2 |
| MBPP | 63.2 |
| MMLU Pro | 32.4 |
| MMLU-Redux | 50.7 |
| MultiPL-E (HumanEval, 8-language average) | 50.4 |