Atlas

Benchmarks

Prophet Arena Arena Score (Agentic, OpenCode)

Prophet Arena (UChicago SIGMA Lab with Kalshi, arXiv 2510.17638) has models forecast open Kalshi prediction-market events and scores them once the events resolve; in the agentic track each model runs as an agent in an OpenCode harness and gathers its own information, with up to an hour per event. The Arena score is each forecaster's skill from an item-response fit over every resolved event and forecaster, anchored so the market's own prices sit at zero skill, translated to predicted 1 - Brier on one shared reference set and shown x100. The fit is joint across the cohort and refit as events resolve, so every value moves with the cohort and the score is diagnostic.

Models
17
Top score
86.2
Leader
GPT-6 Astra
Updated
Nov 14, 2026
Resolution
—
Saturation
—

No signal or difficulty estimate. Held out of the fit by design.

Organizations
17 dated models · 5 frontier modelsClosed weightsOpen weights
Data: Prophet Arenaatlas.village.dev

Prophet Arena Arena Score (Agentic, OpenCode) leaderboard

#ModelSettingScoreSource
1GPT-6 Astranot reported · OpenCode
86.2
2Claude Opus 5.5not reported · OpenCode
86.2
3Kimi K3.1 Pronot reported · OpenCode
86.1
4Gemini 4 Argonnot reported · OpenCode
86.0
5Claude Fable 5.1not reported · OpenCode
86.0
6GPT-6.1 Solnot reported · OpenCode
86.0
7Gemini 3.8 Flashnot reported · OpenCode
86.0
8Claude Haiku 5.5not reported · OpenCode
85.9
9GLM-5.3not reported · OpenCode
85.7
10Claude Sonnet 5.5not reported · OpenCode
85.7
11GPT-6.1 Terranot reported · OpenCode
85.7
12GPT-6 Lunanot reported · OpenCode
85.6
13Grok 4.6not reported · OpenCode
85.6
14Gemini 3.1 Pro Previewnot reported · OpenCode
85.5
15Muse Wondernot reported · OpenCode
85.4
16Kimi K3not reported · OpenCode
85.3
17GLM-5.2not reported · OpenCode
85.3

Related benchmarks

Most correlated

Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).

Loading Atlas data…