Atlas

Models

← All models

Llama 3.2 11B Vision Instruct

Meta · 2024-09-25 · 10.7B parameters

Llama 3.2 11B Vision Instruct is Meta's instruction-tuned multimodal generation model, built on Llama 3.1 with an image encoder and cross-attention adapter layers. It accepts text and images and produces text for visual recognition, image reasoning, captioning, document visual question answering, and assistant-style chat.

Benchmark scores

BenchmarkScore
AA-LCR11.7
AA-LCR v1.112.7
AA-Omniscience Index-62.6
AI2D (OpenVLM)77.3
AidanBench486
AIME 2025 (Artificial Analysis avg@10)1.7
Artificial Analysis Omniscience Accuracy10.6
Artificial Analysis Omniscience Hallucination Rate81.9
Artificial Analysis Openness Index38.9
Artificial Analysis Progress Index v1129
BALROG16.8
BALROG — BabaIsAI (LLM)15.6
BALROG — BabaIsAI (VLM)5.8
BALROG — BabyAI (LLM)50.0
BALROG — BabyAI (VLM)18.0
BALROG — Crafter (LLM)26.2
BALROG — Crafter (VLM)15.9
BALROG — MiniHack (LLM)2.5
BALROG — MiniHack (VLM)2.5
BALROG — NetHack (LLM)0.0
BALROG — NetHack (VLM)0.0
BALROG — TextWorld (LLM)6.7
BALROG (VLM)8.4
Capability105.4
CritPt (avg@5)0.0
EQ-Bench v267.9
GPQA Diamond (Artificial Analysis avg@5)22.1
HallusionBench (OpenVLM)40.3
Humanity's Last Exam (Text-Only)5.5
IFBench (Artificial Analysis avg@5)30.4
Loading Atlas data…