Qwen1.5 0.5B Chat
Alibaba · 2024-02-04 · 620M parameters
Qwen1.5-0.5B-Chat is the aligned chat checkpoint of the 0.5B Qwen1.5 model, announced on February 4, 2024. It is a dense decoder-only Transformer with 619,570,176 parameters and a 32,768-token context window; Qwen states that the Qwen1.5 chat models were post-trained with supervised fine-tuning and direct preference optimization.
Benchmark scores
| Benchmark | Score |
|---|---|
| C-Eval | 37.2 |
| Capability | 64.3 |
| GSM8K | 11.3 |
| IFEval (prompt-level strict accuracy) | 14.6 |
| MBPP | 14.5 |
| MMLU | 35.0 |