Qwen2.5 Coder 1.5B Instruct
Alibaba · 2024-09-19 · 1.5B parameters
Qwen2.5-Coder-1.5B-Instruct is the instruction-tuned 1.5-billion-parameter model of Alibaba's Qwen2.5-Coder family, first released with the September 19, 2024 Qwen2.5-Coder launch. It uses grouped-query attention and tied embeddings with a 32,768-token context.
Benchmark scores
| Benchmark | Score |
|---|---|
| BigCodeBench Instruct | 32.5 |
| BigCodeBench-Hard Instruct | 6.8 |
| Capability | 111.6 |
| HumanEval | 70.7 |
| HumanEval+ | 66.5 |
| LiveCodeBench - July to November 2024 | 6.1 |
| LiveCodeBench - July to September 2024 | 6.1 |
| MBPP | 69.2 |
| MBPP+ | 59.4 |
| MultiPL-E (HumanEval, 8-language average) | 56.7 |