Atlas

Models

← All models

Llama 3.2 90B Vision Instruct

Meta · 2024-09-25 · 88.6B parameters

Llama 3.2 90B Vision Instruct is Meta's instruction-tuned multimodal model built on a Llama 3.1 text backbone with a separately trained image encoder and cross-attention adapter. It accepts text and images and generates text for visual recognition, image reasoning, captioning, document understanding, and assistant-style chat; Meta reports a December 2023 knowledge cutoff.

Benchmark scores

BenchmarkScore
AI2D (OpenVLM)69.5
AidanBench538
Artificial Analysis Openness Index38.9
Artificial Analysis Progress Index v1147
BALROG27.3
BALROG — BabaIsAI (LLM)43.9
BALROG — BabaIsAI (VLM)21.9
BALROG — BabyAI (LLM)72.0
BALROG — BabyAI (VLM)66.0
BALROG — Crafter (LLM)31.7
BALROG — Crafter (VLM)14.5
BALROG — MiniHack (LLM)5.0
BALROG — MiniHack (VLM)2.5
BALROG — NetHack (LLM)0.0
BALROG — NetHack (VLM)0.0
BALROG — TextWorld (LLM)11.2
BALROG (VLM)21.0
Capability118.0
Coding984
Epoch Capabilities Index (ECI)126
EQ-Bench v282.0
EQ-Bench v2 + MAGI-Hard Combined79.9
GPQA Diamond41.0
GPQA Diamond (Artificial Analysis avg@5)43.2
HallusionBench (OpenVLM)44.1
Humanity's Last Exam (Preview)5.5
Humanity's Last Exam (Text-Only)4.5
Humanity's Last Exam Text Only (Preview)5.5
Instruction Following82.1
LiveCodeBench (Artificial Analysis)21.4
Loading Atlas data…