Atlas

Benchmarks

← All benchmarks

RefCOCO, RefCOCO+ and RefCOCOg eight-split average

Multimodal

Referring-expression grounding averaged over eight standard splits: RefCOCO val/testA/testB, RefCOCO+ val/testA/testB and RefCOCOg (umd) val/test. Each split scores box accuracy at IoU >= 0.5 (P@1), and the reported number is the unweighted mean of the eight split accuracies, a release-card convention rather than an aggregate defined by the dataset authors.

Top models (higher is better)

ModelScore
LFM3-VL-2B90.5
LFM2.5-VL-3B87.9
Qwen3.5-4B87.4
Gemma 4 12B IT82.2
GPT-5.6 Luna81.8
Gemini 3.5 Flash-Lite81.6
Qwen3.5-2B78.3
Gemma 4 E2B IT68.0
Loading Atlas data…