DeepSeek R1 0528 Qwen3 8B
DeepSeek · 2025-05-28 · 8.2B parameters
DeepSeek-R1-0528-Qwen3-8B is an 8B dense reasoning model released May 28, 2025, created by distilling DeepSeek's R1-0528 reasoning model into a Qwen3-8B base backbone. The chain-of-thought distillation transfers strong step-by-step math and reasoning behavior into the smaller open-weight Qwen3 model. Its published configuration extends the Qwen3 backbone's 32K original window to 128K with YaRN scaling.