Grok 1
xAI · 2024-03-17
Grok 1 is xAI's first-generation language model, released as open weights in March 2024 under Apache 2.0 as a base (pretrained, non-instruction-tuned) checkpoint. xAI describes it as a 314B-class mixture-of-experts model with 25% of its weights active for a given token, but does not publish exact total or active parameter counts. The checkpoint was originally trained in JAX.
Benchmark scores
| Benchmark | Score |
|---|
No benchmark scores recorded.