CodeQwen1.5 7B Chat
Alibaba · 2024-04-16 · 7.3B parameters
CodeQwen1.5-7B-Chat is the chat-tuned version of Alibaba's CodeQwen1.5-7B code model, released on April 16, 2024. The base was pretrained on about 3 trillion tokens of code across 92 programming languages, and the chat model supports a 65,536-token context and uses grouped-query attention.
Benchmark scores
| Benchmark | Score |
|---|---|
| BigCodeBench Instruct | 39.6 |
| BigCodeBench-Hard Instruct | 18.9 |
| Capability | 121.7 |
| HumanEval | 83.5 |
| HumanEval+ | 78.7 |
| LiveCodeBench - July to September 2024 | 7.9 |
| MBPP+ | 67.2 |
| MultiPL-E (HumanEval, 8-language average) | 70.8 |