Atlas

Benchmarks

Code2Video Arena Elo

Kaggle and HeyGen's arena for HeyGen's Code2Video design briefs: each model writes an animated video composition for a brief, and people vote blind between two models' rendered videos (A, B, both good or both bad). Kaggle reports an Elo rating from those votes, recomputed about every ten minutes, with an interval whose level it doesn't state. Unlike Code2Video-AA, which uses a Gemini judge, the ratings come from human votes.

Models
12
Top score
1599
Leader
Gemini 4 Carbon
Updated
—
Resolution
~1 mo
Sharp
Saturation
—
Signal
95thpercentile
217 benchmarks from 0.8 to 3.7226 benchmarks from 3.7 to 6.6136 benchmarks from 6.6 to 9.5100 benchmarks from 9.5 to 12.451 benchmarks from 12.4 to 15.223 benchmarks from 15.2 to 18.115 benchmarks from 18.1 to 21.06 benchmarks from 21.0 to 23.97 benchmarks from 23.9 to 26.85 benchmarks from 26.8 to 29.73 benchmarks from 29.7 to 32.65 benchmarks from 32.6 to 35.43 benchmarks from 35.4 to 38.32 benchmarks from 38.3 to 41.21 benchmark from 41.2 to 44.11 benchmark from 47.0 to 49.91 benchmark from 49.9 to 52.81 benchmark from 67.2 to 70.1

41st strongest of 803

Signal-to-noise +19.74

Difficulty
73rdpercentile
1 benchmark from 5.4 to 14.31 benchmark from 23.1 to 32.02 benchmarks from 32.0 to 40.91 benchmark from 40.9 to 49.82 benchmarks from 49.8 to 58.69 benchmarks from 58.6 to 67.57 benchmarks from 67.5 to 76.418 benchmarks from 76.4 to 85.324 benchmarks from 85.3 to 94.241 benchmarks from 94.2 to 103.031 benchmarks from 103.0 to 111.939 benchmarks from 111.9 to 120.850 benchmarks from 120.8 to 129.776 benchmarks from 129.7 to 138.561 benchmarks from 138.5 to 147.4116 benchmarks from 147.4 to 156.3129 benchmarks from 156.3 to 165.2121 benchmarks from 165.2 to 174.038 benchmarks from 174.0 to 182.920 benchmarks from 182.9 to 191.811 benchmarks from 191.8 to 200.71 benchmark from 200.7 to 209.54 benchmarks from 209.5 to 218.4

213th hardest of 803

Capability needed 163.7

Organizations
12 dated models · 6 frontier modelsClosed weightsOpen weights
Data: Kaggleatlas.village.dev

Code2Video Arena Elo leaderboard

Related benchmarks

Loading Atlas data…