Atlas

Benchmarks

← All benchmarks

V* Bench

Multimodal · 2023-12-21

V* Bench evaluates visual search in high-resolution images with 191 multiple-choice questions on small-object attribute recognition and relative spatial position. This row holds no-tool runs; runs with a code interpreter for cropping and zooming use the with-Python row.

Top models (higher is better)

ModelScore
Qwen3.6 27B94.7
Qwen3.6 Plus (2026-04-02)90.5
Qwen3.5 122B A10B90.1
Qwen3.6 35B A3B90.1
Qwen3.5-4B89.5
Qwen3.5 35B A3B89.5
Qwen3.5-9B88.5
Gemini 3 Pro Preview88.0
LFM3-VL-2B86.4
Qwen3.5-2B85.9
GPT-5.6 Luna79.6
Kimi K2.577.0
GPT-5.275.9
Gemini 3.5 Flash-Lite74.9
GPT-4o (source unspecified)73.9
GPT-5 Mini71.7
o1 (2024-12-17)69.7
Gemma 4 12B IT69.6
Gemini 2.5 Flash-Lite69.6
GPT-5 Nano68.1
Opus 4.567.0
Sonnet 4.558.6
Gemma 4 E2B IT44.5
Loading Atlas data…