DeepSeek LLM 7B Chat
DeepSeek · 2023-11-29 · 6.9B parameters
DeepSeek LLM 7B Chat is the instruction-tuned checkpoint of DeepSeek LLM 7B Base, released November 29, 2023; DeepSeek reports supervised fine-tuning on about 1.5 million English and Chinese instances followed by DPO. It keeps the base model's 30-layer multi-head-attention architecture and 4,096-token context, with 6,910,365,696 parameters computed from its configuration.
Benchmark scores
| Benchmark | Score |
|---|---|
| C3 | 66.4 |
| Capability | 89.1 |
| CCPM | 76.5 |
| ChID | 64.9 |
| DROP | 49.1 |
| HellaSwag (Unspecified Scoring Protocol) | 68.5 |
| OpenBookQA | 54.8 |
| PIQA | 77.6 |
| RACE-High | 50.8 |
| RACE-Middle | 65.2 |
| WinoGrande | 66.9 |