Qwen1.5 1.8B
Alibaba · 2024-02-04 · 1.8B parameters
Qwen1.5-1.8B is a base (pretrained) checkpoint of Alibaba's Qwen1.5 family, announced on February 4, 2024. It is a dense decoder-only Transformer with 1,836,828,672 parameters and a 32,768-token context window; Qwen1.5-1.8B-Chat is its aligned counterpart.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC-Challenge | 37.9 |
| BBH (BIG-Bench Hard) | 24.2 |
| C-Eval | 59.7 |
| Capability | 76.2 |
| CMMLU | 57.8 |
| GSM8K | 38.4 |
| HellaSwag (Unspecified Scoring Protocol) | 61.4 |
| HumanEval | 20.1 |
| MATH | 10.1 |
| MBPP | 18.0 |
| MMLU | 46.8 |
| TruthfulQA (Unspecified Metric) | 39.4 |
| WinoGrande | 60.3 |