Atlas

Benchmarks

KradleBench

Kradle's KradleBench puts models in live, multi-agent Minecraft worlds, where each model reads JSON observations and acts by writing JavaScript against a fixed skills library while teammates, opponents, creatures and the clock keep moving. Its overall score out of 100 weights five dimensions: Collaboration, Economy and Conflict at 30% each (team builds, a crop market and battle-royale and survival games against copies of reference models) and Logic and Creativity at 5% each (redstone circuits and judged open-brief builds), over 345 runs of 13 challenges per model in battery kb-1.8.2. The launch board also scores a human player, SethBling, at 77.21, second to GPT-6.2 Astra's 78.28; human rows are not imported.

Models
24
Top score
78.3
Leader
GPT-6.2 Astra
Updated
Nov 18, 2026
Resolution
~6 mo
Useful
Saturation
~Aug 2027
Projected
Signal
23rdpercentile
141 benchmarks from 0.8 to 2.9196 benchmarks from 2.9 to 5.0131 benchmarks from 5.0 to 7.1105 benchmarks from 7.1 to 9.282 benchmarks from 9.2 to 11.365 benchmarks from 11.3 to 13.327 benchmarks from 13.3 to 15.421 benchmarks from 15.4 to 17.58 benchmarks from 17.5 to 19.68 benchmarks from 19.6 to 21.76 benchmarks from 21.7 to 23.84 benchmarks from 23.8 to 25.95 benchmarks from 25.9 to 28.03 benchmarks from 28.0 to 30.12 benchmarks from 30.1 to 32.14 benchmarks from 32.1 to 34.21 benchmark from 34.2 to 36.33 benchmarks from 36.3 to 38.41 benchmark from 38.4 to 40.52 benchmarks from 40.5 to 42.61 benchmark from 42.6 to 44.71 benchmark from 44.7 to 46.81 benchmark from 48.9 to 50.9

633rd strongest of 818

Signal-to-noise +3.32

Difficulty
90thpercentile
1 benchmark from 5.8 to 14.71 benchmark from 23.5 to 32.42 benchmarks from 32.4 to 41.21 benchmark from 41.2 to 50.12 benchmarks from 50.1 to 58.99 benchmarks from 58.9 to 67.88 benchmarks from 67.8 to 76.718 benchmarks from 76.7 to 85.523 benchmarks from 85.5 to 94.441 benchmarks from 94.4 to 103.232 benchmarks from 103.2 to 112.141 benchmarks from 112.1 to 121.049 benchmarks from 121.0 to 129.875 benchmarks from 129.8 to 138.760 benchmarks from 138.7 to 147.5122 benchmarks from 147.5 to 156.4135 benchmarks from 156.4 to 165.3124 benchmarks from 165.3 to 174.139 benchmarks from 174.1 to 183.021 benchmarks from 183.0 to 191.88 benchmarks from 191.8 to 200.72 benchmarks from 200.7 to 209.54 benchmarks from 209.5 to 218.4

83rd hardest of 818

Capability needed ≳ 172.9

Organizations
24 dated models · 5 frontier modelsClosed weightsOpen weights
Data: Kradleatlas.village.dev

KradleBench leaderboard

#ModelSettingScoreSource
1GPT-6.2 Astramedium
78.3
2GPT-6.2 Solmedium
67.9
3GPT-6 Astranot reported
56.1
4GPT-6.1 Solnot reported
54.6
5GPT-6.1 Terranot reported
48.6
6Gemini 4 Hydrogenlow
43.9
7Claude Opus 5.5not reported
39.1
8Claude Fable 5.2low
37.8
9Claude Sonnet 5.5not reported
33.8
10Gemini 4 Argonlow
28.6
11Muse Wonderlow
27.6
12Muse Embernot reported
25.7
13Gemini 3.8 Flashlow
24.3
14Grok 4.7low
23.0
15Gemini 4 Carbonlow
22.0
16Muse Spark 1.3not reported
21.7
17GLM-5.3low
21.2
18GPT-6 Lunanot reported
18.1
19Gemma 4 31B ITdisabled
17.1
20Kimi K3.1 Pro—
15.5
21Muse Spark Opennot reported
15.2
22Claude Haiku 5.5not reported
15.0
23Nemotron 3.5 Super VL 120B A12B (precision unspecified)disabled
11.2
24Qwen4-Maxlow
11.0

Related benchmarks

Most correlated

Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).

Loading Atlas data…