← All models

Qwen 7B Chat

Alibaba · 2023-08-03 · 7.7B parameters

Qwen-7B-Chat is Alibaba Cloud's chat-tuned assistant built on the original Qwen-7B base model, first released on August 3, 2023 and updated on September 25, 2023 together with the stronger Qwen-7B base. It is a text-only dense Transformer aligned with supervised fine-tuning and RLHF; its configuration records an 8,192-token sequence length and a 32,768-token maximum with dynamic NTK and LogN attention scaling.

Benchmark scores