Gemma 3 4B PT
Google · 2025-03-12 · 4.3B parameters
Gemma 3 4B PT is Google's open-weight, pre-trained multimodal checkpoint in the Gemma 3 family, released on March 12, 2025 alongside its instruction-tuned variant. It accepts text and images and generates text, supports a 131,072-token context window and pretrained coverage of more than 140 languages, and was trained on 4 trillion mixed image-and-text tokens using knowledge distillation. Google reports an August 2024 knowledge cutoff.
Benchmark scores
| Benchmark | Score |
|---|---|
| AGIEval English | 42.1 |
| ARC-Challenge | 56.2 |
| ARC-Easy | 82.4 |
| BBH (BIG-Bench Hard) | 50.9 |
| BoolQ | 72.3 |
| Capability | 91.2 |
| DROP | 60.1 |
| Global MMLU Lite — Google Unspecified Language Cohort | 57.0 |
| GPQA Diamond | 15.0 |
| GSM8K | 38.4 |
| HellaSwag (Unspecified Scoring Protocol) | 77.2 |
| HumanEval | 36.0 |
| MATH | 24.2 |
| MBPP | 46.0 |
| MGSM | 34.7 |
| MMLU | 59.6 |
| MMLU Pro | 29.2 |
| MMMU | 39.2 |
| Natural Questions (open-domain, closed-book) | 20.0 |
| PIQA | 79.6 |
| RealWorldQA - release-reported visual perception | 45.5 |
| Social IQa (SIQA) | 51.9 |
| TriviaQA | 65.8 |
| WinoGrande | 64.7 |