← All models

Code Llama Python 34B

Meta · 2023-08-24 · 33.7B parameters

Code Llama - Python 34B is the Python-specialized 34-billion-parameter checkpoint of Meta's Code Llama family, released on August 24, 2023. It starts from the Code Llama 34B code-training stage, trains on a further 100B tokens of Python-heavy data, then goes through the same 16,384-token long-context stage, and uses grouped-query attention with eight key-value heads.

Benchmark scores