InfographicVQA

Name: InfographicVQA
Published: 2021-04-26

Multimodal · 2021-04-26

InfographicVQA asks questions about infographic images that combine text, layout, charts, icons and data visualizations, many of which require simple arithmetic or counting. This row is the 3,288-question test split scored by Average Normalized Levenshtein Similarity (ANLS). Higher is better.

Top models (higher is better)

Model	Score
Gemma 4 31B IT	92.0
Qwen3 VL 235B A22B Thinking	89.5
Gemma 4 26B A4B IT	89.3
Qwen3-VL-235B-A22B-Instruct	89.2
Qwen3 VL 32B Thinking	89.2
Gemma 4 12B IT	88.4
Qwen2.5-VL-72B-Instruct	87.3
Qwen3 VL 32B Instruct	87.0
Qwen3 VL 8B Thinking	86.0
Qwen2 VL 72B Instruct	84.5
Gemini 2.5 Pro	84.2
InternVL2.5-78B	84.1
Qwen2.5 VL 32B Instruct	83.4
Qwen3-VL-8B-Instruct	83.1
Qwen3 VL 4B Thinking	83.0
Qwen2.5-VL-7B-Instruct	82.6
Gemini 2.5 Flash	82.5
Gemini 1.5 Pro (May 2024)	81.0
Qwen3 VL 4B Instruct	80.3
GPT-5	79.0
Qwen2.5-VL-3B-Instruct	77.1
Qwen3 VL 2B Thinking	77.1
Qwen2 VL 7B Instruct	76.5
Gemini 1.5 Flash (May 2024 report)	75.3
Gemini 1.5 Pro (February 2024 report)	72.7
Qwen3 VL 2B Instruct	72.4
Gemma 3 27B IT	70.6
Gemma 4 E4B IT	70.0
Opus 4.1	69.4
GPT-5 Nano	68.6
Qwen2 VL 2B Instruct	65.5
Gemma 3 12B IT	64.9
Gemma 4 E2B IT	63.9
Sonnet 4	58.0
Gemini Nano 2	54.5
Gemini Nano 1	51.1
Gemma 3 4B IT	50.0