Qwen3 14B Base
Alibaba · 2025-04-29 · 14.8B parameters
Qwen3-14B-Base is the pre-trained (not instruction-tuned) 14B dense checkpoint of Alibaba's Qwen3 family, released April 29, 2025 under Apache 2.0 alongside the post-trained Qwen3-14B. Qwen describes a three-stage pre-training on about 36 trillion tokens in 119 languages, ending with long-context training at 32,768 tokens, which is the checkpoint's configured context length.
Benchmark scores
| Benchmark | Score |
|---|---|
| BBH (BIG-Bench Hard) | 81.1 |
| Capability | 119.9 |
| GSM8K | 92.5 |
| MATH | 62.0 |
| MGSM | 79.2 |
| MMLU | 81.0 |
| MMLU Pro | 61.0 |
| MMLU-Redux | 79.9 |
| SuperGPQA | 34.3 |