Qwen2.5 Coder 0.5B Instruct
Alibaba · 2024-11-12 · 494M parameters
Qwen2.5-Coder-0.5B-Instruct is the smallest instruction-tuned model of Alibaba's Qwen2.5-Coder family, released on November 12, 2024. It has 494,032,768 parameters with grouped-query attention and tied embeddings, and a 32,768-token context.
Benchmark scores
| Benchmark | Score |
|---|---|
| BigCodeBench Instruct | 11.1 |
| BigCodeBench-Hard Instruct | 1.4 |
| Capability | 99.8 |
| HumanEval | 61.6 |
| HumanEval+ | 57.3 |
| LiveCodeBench - July to November 2024 | 2.0 |
| LiveCodeBench - July to September 2024 | 2.0 |
| MBPP | 52.4 |
| MBPP+ | 43.7 |
| MultiPL-E (HumanEval, 8-language average) | 49.6 |