ChatGLM 6B
Zhipu AI (Z.ai) · 2023-03-14 · 6.2B parameters
ChatGLM-6B is the original open-weight bilingual chat model, marketed as 6.2B parameters, from Zhipu AI and Tsinghua University's KEG lab, publicly released in March 2023. It was pre-trained on approximately one trillion Chinese and English tokens with a 2K context window and aligned for dialogue with supervised fine-tuning and related preference-training methods. The model is based on the General Language Model (GLM) framework.