GSM1k
Math
Scale's held-out GSM8K-style mathematics benchmark, evaluated with a five-shot prompt. The paper describes 1,250 problems while the linked leaderboard describes 1,000; the exact scored cohort is unresolved, so no canonical item count is asserted. The paper's 1,205 figure counts human odd-one-out audit attempts, not benchmark math problems.