AIME 2024 (with tools)
Math · 2024-02-07
AIME 2024's 30 problems from the 2024 American Invitational Mathematics Examination solved with tools available, usually a Python interpreter or code execution; some reports do not itemize the tools. Tool runs approach a perfect score and are not comparable with runs without tools, which are scored under AIME 2024.
Benchmark source: Maa
Top models (higher is better)
| Model | Score | Source |
|---|---|---|
| o4-mini | 98.7 | gpt-oss launch post · OpenAI |
| gpt-oss-120b | 96.6 | gpt-oss launch post · OpenAI |
| gpt-oss-20b | 96.0 | gpt-oss launch post · OpenAI |
| o3 | 95.2 | gpt-oss launch post · OpenAI |