DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek · 2025-01-20 · 1.8B parameters
DeepSeek-R1-Distill-Qwen-1.5B is a dense reasoning checkpoint produced by supervised fine-tuning of Qwen2.5-Math-1.5B on approximately 800,000 samples curated with DeepSeek-R1, without an RL stage. Released January 20, 2025, it is the smallest model in the original R1 distillation series; its architecture config declares 131,072 positions while tokenizer_config.json sets model_max_length to 16,384.