Atlas

Benchmarks

← All benchmarks

Medical Long Context Reasoning (MLCR-AA, October 2026 methodology)

Professional Work

Artificial Analysis' revised MLCR-AA methodology, first published between October 19 and 21, 2026: 60 private held-out expert-tier and compound questions from Wisedocs Medical Long Context Reasoning, over synthetic records of about 25,000 to 64,000 tokens, each run three times. A response passes when a majority of three judges (Claude Opus 5.5, GPT-6.1 Sol and Grok 4.7 at medium effort) each find it complete, naming every documentation gap on the way to the ground-truth conclusion, and free of claims that contradict the record. Empty responses fail. The earlier conciseness gate is gone and AA re-scored every model, so these results are not comparable with mlcr-aa.

Top models (higher is better)

ModelScore
Claude Sonnet 5.541.7
GPT-6 Astra41.7
GPT-6.1 Sol38.3
Kimi K3.1 Pro38.3
Claude Haiku 5.535.0
GPT-6 Sol33.9
GPT-5.5 Instant (2026-06-25 hosted snapshot)31.7
GPT-6.1 Terra30.6
Qwen3.8 2.4T A95B30.6
GPT-5.6 Sol30.0
GPT-5.528.9
Claude Opus 5.527.8
GPT-5.6 Terra27.2
DeepSeek V4.1 Flash 101726.7
GPT-6 Luna26.1
Qwen3.8-Max26.1
DeepSeek V4.1 Flash23.9
Qwen3.8 27B22.8
Muse Wonder Full22.2
Muse Wonder22.2
Kimi K321.7
Grok 4.721.1
Claude Fable 520.6
Qwen3.8-Flash-Next20.6
GPT-5.4 Mini20.0
GPT-5.6 Luna20.0
Qwen3.8 Max (0902)20.0
Opus 4.819.4
Claude Fable 5.118.3
Grok 4.618.3
Step 5 Preview18.3
Beam 1.0 501B A23B17.8
GLM-5.317.2
MiniMax M3.1 Flash16.7
GPT-5.4 Nano16.1
Grok 4.516.1
Gemini 3.8 Flash15.6
Muse Spark 1.315.6
Ling 3.1 Flash 101915.0
Qwen3.7-Max (source unspecified)14.4
Loading Atlas data…