RecurrentGemma 9B
RecurrentGemma 9B is Google DeepMind's larger open-weight, English text-to-text pre-trained model built on the Griffin architecture, which mixes gated linear recurrences with 2,048-token local attention so its inference state stays fixed in size. Google's technical report gives 8.58 billion total parameters (7.53 billion non-embedding), while the Hugging Face safetensors checkpoint stores 9,628,553,216 values, so total_parameters is left unset; it was trained on 2 trillion tokens of 8,192-token sequences.
Benchmark scores
| Benchmark | Score |
|---|---|
| AGIEval English | 39.3 |
| ARC-Challenge | 52.0 |
| ARC-Easy | 78.8 |
| BBH (BIG-Bench Hard) | 55.2 |
| BoolQ | 80.3 |
| Capability | 93.7 |
| GSM8K | 42.6 |
| HellaSwag (Unspecified Scoring Protocol) | 80.4 |
| HumanEval | 31.1 |
| MATH | 23.8 |
| MBPP | 42.0 |
| MMLU | 60.5 |
| Natural Questions (open-domain, closed-book) | 21.7 |
| OpenBookQA | 51.8 |
| PIQA | 81.3 |
| Social IQa (SIQA) | 52.3 |
| TriviaQA | 70.5 |
| WinoGrande | 73.6 |