LiveCodeBench v1
Code · 2024-03-12
LiveCodeBench release v1, the original 400 code-generation problems collected from LeetCode, AtCoder and Codeforces contests between May 2023 and March 2024. This historical problem cohort is retained as a diagnostic rather than pooled with later LiveCodeBench releases or date windows.
Top models (higher is better)
| Model | Score |
|---|---|
| Qwen2 72B Instruct | 35.7 |
| Llama 3 70B Instruct | 29.3 |
| Qwen2 7B Instruct | 26.6 |
| Qwen2-57B-A14B Instruct | 25.5 |
| Qwen1.5 110B Chat | 25.3 |
| Mixtral 8x22B Instruct | 21.8 |
| Qwen1.5 72B Chat | 17.9 |
| Llama 3 8B Instruct | 17.3 |
| Qwen1.5 32B Chat | 15.2 |
| Mixtral 8x7B Instruct | 12.3 |
| Qwen1.5 7B Chat | 6.0 |