LiveCodeBench - July 2024 to January 2025
Code
The 315 LiveCodeBench release_v5 code-generation problems dated July 1 to December 31, 2024, the split NeMo-Skills calls test_v5_2407_2412 and NVIDIA's Nemotron release materials label 07/24-12/24 or v5 2024-07 to 2024-12. Scored as pass@1. This exact historical problem cohort is retained as a diagnostic rather than pooled with other LiveCodeBench windows.
Top models (higher is better)
| Model | Score |
|---|---|
| Nemotron 3 Super 120B A12B | 81.2 |
| Nemotron Nano 9B V2 | 71.1 |
| Nemotron Nano 12B V2 VL BF16 | 69.4 |
| Qwen3 14B | 63.1 |
| Qwen3 8B | 59.5 |