Gemma 3 27B PT
Google · 2025-03-12 · 27.4B parameters
Gemma 3 27B PT is Google's open-weight, pre-trained multimodal checkpoint in the Gemma 3 family, released on March 12, 2025 alongside its instruction-tuned variant. Its 27,432,406,640-parameter checkpoint accepts text and images and generates text with a 131,072-token context window, and was trained on 14 trillion mixed image-and-text tokens using knowledge distillation. Google reports an August 2024 knowledge cutoff.
Benchmark scores
| Benchmark | Score |
|---|---|
| AGIEval English | 66.2 |
| ARC-Challenge | 70.6 |
| ARC-Easy | 89.0 |
| BBH (BIG-Bench Hard) | 77.7 |
| BoolQ | 82.4 |
| Capability | 113.4 |
| DROP | 77.2 |
| Global MMLU Lite — Google Unspecified Language Cohort | 75.7 |
| GPQA Diamond | 24.3 |
| GSM8K | 82.6 |
| HellaSwag (Unspecified Scoring Protocol) | 85.6 |
| HumanEval | 48.8 |
| MATH | 50.0 |
| MBPP | 65.6 |
| MGSM | 74.3 |
| MMLU | 78.6 |
| MMLU Pro | 52.2 |
| MMMU | 56.1 |
| Natural Questions (open-domain, closed-book) | 36.1 |
| PIQA | 83.3 |
| RealWorldQA - release-reported visual perception | 53.9 |
| Social IQa (SIQA) | 54.9 |
| TriviaQA | 85.5 |
| WinoGrande | 78.8 |