← All models

Code Llama Python 70B

Meta · 2024-01-29 · 69B parameters

Code Llama - Python 70B is the Python-specialized 70-billion-parameter checkpoint of Meta's Code Llama family, released on January 29, 2024. It continues the 1T-token Code Llama 70B code training with 100B tokens of Python-heavy data but, unlike the base 70B, skips long-context fine-tuning, so it keeps a 4,096-token context and the standard RoPE base period of 10,000.

Benchmark scores