DeepSeek-Coder-Instruct 7B v1.5
DeepSeek · 2024-01-25 · 6.9B parameters
DeepSeek-Coder-Instruct v1.5 is the instruction-tuned version of DeepSeek-Coder-Base 7B v1.5, released in January 2024. It keeps the 6,910,365,696-parameter DeepSeek LLM 7B architecture with a 4,096-token context.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC-Challenge | 48.1 |
| BBH (BIG-Bench Hard) | 53.3 |
| Capability | 93.2 |
| HellaSwag (Unspecified Scoring Protocol) | 72.2 |
| HumanEval-Mul | 64.1 |
| MBPP | 64.6 |
| MMLU | 49.5 |
| WinoGrande | 63.4 |