Atlas

Benchmarks

← All benchmarks

A-Fantasia Cube (Valid Attempts with Retries)

Games · 2026-09-30

A-Fantasia cube-rotation error among valid responses under the retry protocol. Six distinct colors and one to three quarter-turns; latest run with at least 80 valid items. Up to five retries for unscorable responses; denominator is not published.

Top models (lower is better)

ModelScore
Claude Opus 547.0
Opus 4.653.0
Opus 4.857.0
Kimi K2 Instruct62.0
Qwen3 Max (rolling alias)62.0
GPT-5.563.0
GPT-5.6 Sol63.0
Kimi K2.664.0
Gemini 1.5 Pro (source unspecified)64.0
DeepSeek-V3-032465.1
Qwen3.7-Plus (source unspecified)66.0
Gemini 1.5 Flash (source unspecified)66.0
GLM-5.167.0
Opus 4.568.0
GPT-5.468.0
Claude 3.7 Sonnet68.0
Gemini 2.0 Flash68.0
Haiku 4.568.0
DeepSeek V4.1 Flash68.0
Llama 3.1 405B Instruct68.0
DeepSeek-V3.2-Exp68.0
Claude 3.5 Sonnet (Oct 2024)69.0
Qwen3.6 Plus (2026-04-02)69.0
Opus 469.1
GLM-569.4
Mistral Large 4 Preview70.0
Sonnet 471.0
DeepSeek-V3.171.0
Opus 4.172.0
Sonnet 4.572.0
GLM-5.272.0
Qwen3.8 Flash72.0
MiniMax M372.0
Sonnet 4.673.0
GPT-5.6 Luna73.0
Nemotron 3 Ultra 550B A55B73.0
Gemini 2.5 Flash-Lite73.6
Grok 4.2073.7
GPT-4o (source unspecified)74.0
Opus 374.0
Loading Atlas data…