Gemma 3 1B PT
Google · 2025-03-12 · 1000M parameters
Gemma 3 1B PT is Google's open-weight, text-only pre-trained checkpoint in the Gemma 3 family, released on March 12, 2025 alongside its instruction-tuned variant. Its 999,885,952-parameter dense decoder supports a 32,768-token context window and was trained on 2 trillion tokens with knowledge distillation; Google reports an August 2024 knowledge cutoff.
Benchmark scores
| Benchmark | Score |
|---|---|
| ARC-Challenge | 38.4 |
| ARC-Easy | 73.0 |
| BBH (BIG-Bench Hard) | 28.4 |
| BoolQ | 63.2 |
| Capability | 60.0 |
| DROP | 42.4 |
| Global MMLU Lite — Google Unspecified Language Cohort | 24.9 |
| HellaSwag (Unspecified Scoring Protocol) | 62.3 |
| MGSM | 2.0 |
| Natural Questions (open-domain, closed-book) | 9.5 |
| PIQA | 73.8 |
| Social IQa (SIQA) | 48.9 |
| TriviaQA | 39.8 |
| WinoGrande | 58.2 |