Code Llama 13B
Meta · 2023-08-24 · 13B parameters
Code Llama 13B is the 13-billion-parameter base checkpoint of Meta's Code Llama family, released on August 24, 2023. It continues training Llama 2 13B on 500B tokens of code-heavy data with a fill-in-the-middle objective, giving both completion and infilling, and its long-context stage at 16,384-token sequences with a RoPE base period of 1,000,000 lets Meta's inference code run it on inputs of up to 100,000 tokens.