Benchmarks
326 sources · 1,256 models × 2,956 benchmarks · 154,484 scoresTCSExam (Tsinghua University, Moonshot AI and Shanghai Qizhi Institute) gives coding agents theoretical computer science research tasks with up to 12 hours each, checked by the Lean kernel or an executable checker: 20 Lean theorems, 30 solver-engineering problems scored against three fixed Kimi K3 runs, 20 constructions scored against a reference, and 30 open conjectures to prove or refute. The Index is 30P + 30S + 30C + 10O over the track means, in points; 100 matches the references everywhere, and constructions that beat their reference can push it past 100.
61st strongest of 779 fitted benchmarks
Signal-to-noise +16.16
215th hardest of 779 fitted benchmarks
Capability needed 162.7
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | GPT-6 Astra | max · Codex | 71.9 | |
| 2 | Kimi K3.1 Pro | max · Kimi Code | 57.4 | |
| 3 | Kimi K3 | max · Kimi Code | 46.8 | |
| 4 | DeepSeek V4.1 Flash 1017 | max · Claude Code | 46.0 | |
| 5 | GLM-5.3 | max · Claude Code | 45.5 | |
| 6 | Qwen3.8 Max (0902) | max · Claude Code | 44.8 | |
| 7 | Grok 4.6 | x-high · Grok Build | 40.5 | |
| 8 | DeepSeek V4.1 Flash | max · Claude Code | 40.4 |