PerceptionBench - Hallucination
Multimodal · 2026-07-16
The PerceptionBench hallucination category contains 271 questions that test whether a model avoids asserting plausible but nonexistent objects, text, or attributes when the visual evidence is absent.
Top models (higher is better)
| Model | Score |
|---|---|
| Gemini 3.5 Flash | 50.6 |
| Doubao Seed 2.1 Pro | 49.8 |
| Grok 4.5 | 44.7 |
| Kimi K3 | 41.7 |
| Kimi K2.6 | 41.0 |
| Gemini 3.1 Pro Preview | 40.6 |
| Opus 4.8 | 38.7 |
| GPT-5.5 | 34.7 |
| Gemma 4 31B IT | 32.1 |
| MiniMax M3 | 29.9 |
| Qwen3.7-Plus (source unspecified) | 29.5 |
| GLM 5V Turbo | 28.0 |
| GLM-4.6V | 26.9 |
| GPT-5.6 Sol | 26.9 |
| Qwen3.5 397B A17B | 26.9 |