Humanity's Last Exam (Preview)

Name: Humanity's Last Exam (Preview)
Published: 2025-01-24

General QA · 2025-01-24

Preview score on Humanity's Last Exam expert-level questions across science, math, and humanities.

Model	Score
Gemini 2.5 Pro Preview 03-25	18.8
O1 Pro	9.2
Claude 3.7 Sonnet	8.9
o1 (source unspecified)	8.8
Gemini 2.0 Flash Thinking Experimental 01-21	7.2
Gemini 2.0 Pro Experimental 02-05	7.1
Llama 4 Maverick Instruct	6.8
GPT-4.5	6.4
Llama 3.2 90B Vision Instruct	5.5
Gemini 1.5 Pro 002	5.2
Gemini 2.0 Flash Experimental	5.2
Gemini 2.0 Flash	5.1
Claude 3.5 Sonnet (Oct 2024)	4.8
Qwen2 VL 72B Instruct	4.7
Nova Pro	4.6
Gemini 2.0 Flash-Lite	4.6
Opus 3	4.2
Gemini 1.5 Flash 002	4.2
Nova Lite	4.0
GPT-4o (2024-11-20)	3.1