Benchmarks
347 sources · 1,258 models × 3,038 benchmarks · 158,912 scoresNeel Nanda's NoCoT-Bench measures how much reasoning a language model can do in a single forward pass, with no chain of thought, which bears on how much reasoning a chain-of-thought monitor could miss. Models answer generated problems (arithmetic chains, sudoku, shortest paths, context-free grammars, multi-hop and multi-document tasks, order tracking, constraint counting and more, plus GPQA and contest items) at once, under per-model recipes that suppress reasoning, and every row is checked for reasoning tokens and visible working; a row that reasoned is scored wrong. NCRI 15.2 is a Rasch ability fitted over 76 difficulty rungs (64 sealed, plus 12 harder rungs bought for the top 35 models) in 19 effective domains and reported as 100 + (10/ln 2)·θ: 100 is the average sealed rung, +10 points doubles the odds of solving any rung, and negative values are allowed. The scale is anchored on the sealed items rather than the models but is unbounded, so it stays out of the capability fit.
No signal or difficulty estimate. This benchmark has no declared score range, so it cannot be placed on the 0-1 scale the capability curve requires.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | GPT-6 Astra | disabled · NoCoT-Bench no-chain-of-thought ask | 159 | |
| 2 | Gemini 4 Argon | disabled · NoCoT-Bench no-chain-of-thought ask | 151 | |
| 3 | GPT-6.1 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 149 | |
| 4 | GPT-6.1 Terra | disabled · NoCoT-Bench no-chain-of-thought ask | 130 | |
| 5 | Claude Fable 5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 128 | |
| 6 | Gemini 3.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 126 | |
| 7 | Gemini 3.8 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 126 | |
| 8 | Claude Fable 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 119 | |
| 9 | Gemini 3.1 Pro Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 115 | |
| 10 | Claude Opus 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 115 | |
| 11 | GPT-6 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 115 | |
| 12 | GPT-5.6 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 109 | |
| 13 | Opus 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 104 | |
| 14 | Opus 4.7 | disabled · NoCoT-Bench no-chain-of-thought ask | 104 | |
| 15 | Gemini 3 Flash Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 16 | Kimi K3.1 Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 17 | Opus 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 18 | Opus 4.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 19 | Opus 4.8 | disabled · NoCoT-Bench no-chain-of-thought ask | 102 | |
| 20 | Gemini 3.5 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 102 | |
| 21 | Opus 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 101 | |
| 22 | Gemini 3.6 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 101 | |
| 23 | GPT-5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 100 | |
| 24 | Gemini 2.5 Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 99.8 | |
| 25 | Muse Spark 1.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 98.3 | |
| 26 | Muse Wonder | disabled · NoCoT-Bench no-chain-of-thought ask | 97.7 | |
| 27 | Muse Spark 1.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 97.1 | |
| 28 | Muse Spark 1.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 96.8 | |
| 29 | Kimi K3 | disabled · NoCoT-Bench no-chain-of-thought ask | 96.8 | |
| 30 | Muse Spark Open | disabled · NoCoT-Bench no-chain-of-thought ask | 95.7 | |
| 31 | Claude Sonnet 5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 95.1 | |
| 32 | Hy4 | disabled · NoCoT-Bench no-chain-of-thought ask | 94.0 | |
| 33 | GPT-5.4 | disabled · NoCoT-Bench no-chain-of-thought ask | 94.0 | |
| 34 | Sonnet 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 94.0 | |
| 35 | Sonnet 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 91.3 | |
| 36 | Sonnet 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 90.8 | |
| 37 | GPT-5.6 Terra | disabled · NoCoT-Bench no-chain-of-thought ask | 89.0 | |
| 38 | Sonnet 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 87.8 | |
| 39 | Qwen3.6-Max-Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 87.0 | |
| 40 | Grok 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 86.8 | |
| 41 | Qwen3.8 2.4T A95B | disabled · NoCoT-Bench no-chain-of-thought ask | 86.0 | |
| 42 | GPT-5.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 85.8 | |
| 43 | GPT-5.3-Codex | disabled · NoCoT-Bench no-chain-of-thought ask | 85.2 | |
| 44 | DeepSeek V4 Pro 0813 | disabled · NoCoT-Bench no-chain-of-thought ask | 84.1 | |
| 45 | Hy4 Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 82.8 | |
| 46 | LongCat-2.0 | disabled · NoCoT-Bench no-chain-of-thought ask | 82.5 | |
| 47 | Qwen3.6 Plus (2026-04-02) | disabled · NoCoT-Bench no-chain-of-thought ask | 82.2 | |
| 48 | Qwen3 Max Thinking (2026-01-23) | disabled · NoCoT-Bench no-chain-of-thought ask | 81.9 | |
| 49 | DeepSeek V4.1 Flash 1017 | disabled · NoCoT-Bench no-chain-of-thought ask | 81.6 | |
| 50 | Gemma 4 31B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 81.0 | |
| 51 | Grok 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 81.0 | |
| 52 | KAT-Coder-Pro V2 | not supported · NoCoT-Bench no-chain-of-thought ask | 80.8 | |
| 53 | Gemini 3.5 Flash-Lite | disabled · NoCoT-Bench no-chain-of-thought ask | 80.6 | |
| 54 | Qwen3.5 Plus (2026-02-15) | disabled · NoCoT-Bench no-chain-of-thought ask | 80.6 | |
| 55 | Kimi K2.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 80.6 | |
| 56 | Qwen3.5 397B A17B | disabled · NoCoT-Bench no-chain-of-thought ask | 80.0 | |
| 57 | Kimi K2.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 79.2 | |
| 58 | DeepSeek-V4-Flash-Base | not supported · NoCoT-Bench no-chain-of-thought ask | 79.1 | |
| 59 | Gemini 2.5 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 78.8 | |
| 60 | Nemotron 3 Ultra 550B A55B | disabled · NoCoT-Bench no-chain-of-thought ask | 78.3 | |
| 61 | Inkling | disabled · NoCoT-Bench no-chain-of-thought ask | 78.3 | |
| 62 | Kimi K2 Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 78.0 | |
| 63 | DeepSeek-V3.1-Terminus | disabled · NoCoT-Bench no-chain-of-thought ask | 77.6 | |
| 64 | GLM-5.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 77.3 | |
| 65 | GPT-6 Luna | disabled · NoCoT-Bench no-chain-of-thought ask | 77.3 | |
| 66 | Qwen3-VL-235B-A22B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 77.3 | |
| 67 | MiMo-V2.5-Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 77.1 | |
| 68 | DeepSeek-V3.2-Exp | disabled · NoCoT-Bench no-chain-of-thought ask | 76.7 | |
| 69 | GPT-5.6 Luna | disabled · NoCoT-Bench no-chain-of-thought ask | 76.6 | |
| 70 | DeepSeek-V3.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 76.5 | |
| 71 | GLM-5.3 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 76.4 | |
| 72 | GLM-5 | disabled · NoCoT-Bench no-chain-of-thought ask | 76.2 | |
| 73 | DeepSeek-V4-Flash-0731 | disabled · NoCoT-Bench no-chain-of-thought ask | 75.5 | |
| 74 | GLM-5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 75.2 | |
| 75 | GPT-4.1 | not supported · NoCoT-Bench no-chain-of-thought ask | 75.1 | |
| 76 | DeepSeek-V3.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 75.0 | |
| 77 | Qwen3 235B A22B Instruct 2507 | not supported · NoCoT-Bench no-chain-of-thought ask | 74.6 | |
| 78 | GLM-5.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 74.5 | |
| 79 | Qwen3.8 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 74.4 | |
| 80 | DeepSeek-V3-0324 | not supported · NoCoT-Bench no-chain-of-thought ask | 74.4 | |
| 81 | GPT-4o (2024-08-06) | not supported · NoCoT-Bench no-chain-of-thought ask | 74.2 | |
| 82 | Haiku 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 74.2 | |
| 83 | Ling 2.6 1T | not supported · NoCoT-Bench no-chain-of-thought ask | 73.9 | |
| 84 | WizardLM-2 8x22B | not supported · NoCoT-Bench no-chain-of-thought ask | 73.2 | |
| 85 | Qwen3-Coder-480B-A35B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 73.1 | |
| 86 | DeepSeek-V3 | not supported · NoCoT-Bench no-chain-of-thought ask | 72.9 | |
| 87 | GPT-4 0613 | not supported · NoCoT-Bench no-chain-of-thought ask | 72.8 | |
| 88 | MiniMax M3 | disabled · NoCoT-Bench no-chain-of-thought ask | 72.6 | |
| 89 | Hy3 | disabled · NoCoT-Bench no-chain-of-thought ask | 72.5 | |
| 90 | Qwen3.5 Plus 2026-04-20 | disabled · NoCoT-Bench no-chain-of-thought ask | 72.3 | |
| 91 | Mercury 3 | disabled · NoCoT-Bench no-chain-of-thought ask | 72.3 | |
| 92 | Hy3 preview | disabled · NoCoT-Bench no-chain-of-thought ask | 72.3 | |
| 93 | GPT-4o (2024-05-13) | not supported · NoCoT-Bench no-chain-of-thought ask | 72.2 | |
| 94 | GLM-4.7 | disabled · NoCoT-Bench no-chain-of-thought ask | 71.3 | |
| 95 | GPT-4 Turbo | not supported · NoCoT-Bench no-chain-of-thought ask | 71.3 | |
| 96 | GLM-4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 71.3 | |
| 97 | GLM 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 70.8 | |
| 98 | GPT-5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 70.6 | |
| 99 | Qwen3-235B-A22B | disabled · NoCoT-Bench no-chain-of-thought ask | 70.5 | |
| 100 | Llama 4 Maverick Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 70.5 | |
| 101 | GPT-5.4 Mini | disabled · NoCoT-Bench no-chain-of-thought ask | 70.5 | |
| 102 | GPT-4o (2024-11-20) | not supported · NoCoT-Bench no-chain-of-thought ask | 70.3 | |
| 103 | MiMo-V2.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 69.9 | |
| 104 | Gemma 4 26B A4B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 69.5 | |
| 105 | Qwen3.5 122B A10B | disabled · NoCoT-Bench no-chain-of-thought ask | 69.4 | |
| 106 | Grok 4.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 69.2 | |
| 107 | Qwen3 235B A22B Thinking 2507 | always on · NoCoT-Bench no-chain-of-thought ask | 68.9 | |
| 108 | Qwen3 Next 80B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 68.4 | |
| 109 | MiniMax M3.1 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 68.4 | |
| 110 | Claude Haiku 5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 68.3 | |
| 111 | Mistral Medium 3.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 67.5 | |
| 112 | Grok 4.20 | disabled · NoCoT-Bench no-chain-of-thought ask | 67.1 | |
| 113 | GPT-5 | disabled · NoCoT-Bench no-chain-of-thought ask | 67.0 | |
| 114 | ERNIE 4.5 VL 424B A47B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.9 | |
| 115 | GLM-4.5V | disabled · NoCoT-Bench no-chain-of-thought ask | 66.7 | |
| 116 | Qwen3.5-27B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.6 | |
| 117 | Ling 3.0 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 66.3 | |
| 118 | Muse Glimmer 30B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.3 | |
| 119 | Nemotron 3 Super 120B A12B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.2 | |
| 120 | Qwen3.6 27B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.2 | |
| 121 | Qwen3.8 27B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.1 | |
| 122 | Ling 2.6 Flash | not supported · NoCoT-Bench no-chain-of-thought ask | 65.5 | |
| 123 | Qwen3-Coder-Next | not supported · NoCoT-Bench no-chain-of-thought ask | 65.5 | |
| 124 | Solar Pro 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 65.3 | |
| 125 | Qwen2.5-VL-72B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 65.2 | |
| 126 | GPT-4.1 Mini | not supported · NoCoT-Bench no-chain-of-thought ask | 65.0 | |
| 127 | MiniMax M2.5 | always on · NoCoT-Bench no-chain-of-thought ask | 65.0 | |
| 128 | Beam 1.0 501B A23B | disabled · NoCoT-Bench no-chain-of-thought ask | 64.8 | |
| 129 | Hermes 3 Llama 3.1 405B | not supported · NoCoT-Bench no-chain-of-thought ask | 64.6 | |
| 130 | Gemini 2.5 Flash-Lite | disabled · NoCoT-Bench no-chain-of-thought ask | 64.5 | |
| 131 | MiniMax M2.7 | always on · NoCoT-Bench no-chain-of-thought ask | 64.0 | |
| 132 | Qwen3 VL 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 64.0 | |
| 133 | Qwen3-Next-80B-A3B-Thinking | always on · NoCoT-Bench no-chain-of-thought ask | 63.8 | |
| 134 | L3.3-70B-Euryale-v2.3 | not supported · NoCoT-Bench no-chain-of-thought ask | 63.8 | |
| 135 | Gemma 4 31B | not supported · NoCoT-Bench no-chain-of-thought ask | 63.6 | |
| 136 | Mistral Small 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 63.5 | |
| 137 | GLM-4.6V | disabled · NoCoT-Bench no-chain-of-thought ask | 63.4 | |
| 138 | Qwen3.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 63.3 | |
| 139 | Qwen2.5 72B | not supported · NoCoT-Bench no-chain-of-thought ask | 63.1 | |
| 140 | Hermes 4 405B | disabled · NoCoT-Bench no-chain-of-thought ask | 62.8 | |
| 141 | Llama 3.1 70B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 62.8 | |
| 142 | Qwen2.5 Instruct 32B | not supported · NoCoT-Bench no-chain-of-thought ask | 62.7 | |
| 143 | Llama 3.3 70B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 62.6 | |
| 144 | Laguna S 2.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 62.5 | |
| 145 | GLM 4.5 Air | disabled · NoCoT-Bench no-chain-of-thought ask | 62.4 | |
| 146 | Qwen2.5 72B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 62.1 | |
| 147 | Qwen3 30B A3B Instruct 2507 | not supported · NoCoT-Bench no-chain-of-thought ask | 62.1 | |
| 148 | Qwen3.6 35B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 61.6 | |
| 149 | Qwen3.5-Flash (2026-02-23) | disabled · NoCoT-Bench no-chain-of-thought ask | 61.4 | |
| 150 | Nova Pro | not supported · NoCoT-Bench no-chain-of-thought ask | 61.3 | |
| 151 | Qwen2.5 32B | not supported · NoCoT-Bench no-chain-of-thought ask | 61.1 | |
| 152 | Qwen2 72B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 61.0 | |
| 153 | Qwen3.5 35B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 60.1 | |
| 154 | Qwen2.5 Coder 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 60.0 | |
| 155 | Qwen3 VL 30B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 59.9 | |
| 156 | Gemma 4 12B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 59.7 | |
| 157 | Qwen3 Coder 30B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 59.6 | |
| 158 | Ripple-65B Preview | unknown · NoCoT-Bench no-chain-of-thought ask | 59.3 | |
| 159 | Qwen3 32B | disabled · NoCoT-Bench no-chain-of-thought ask | 59.2 | |
| 160 | Cydonia 24B v4.1 | not supported · NoCoT-Bench no-chain-of-thought ask | 59.1 | |
| 161 | Ministral 3 14B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 58.7 | |
| 162 | Phi-4 | not supported · NoCoT-Bench no-chain-of-thought ask | 58.3 | |
| 163 | gpt-oss-120b | disabled · NoCoT-Bench no-chain-of-thought ask | 58.1 | |
| 164 | Hermes 4 70B | disabled · NoCoT-Bench no-chain-of-thought ask | 57.9 | |
| 165 | Llama 4 Scout Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 57.7 | |
| 166 | Llama 3.1 70B | not supported · NoCoT-Bench no-chain-of-thought ask | 57.6 | |
| 167 | Laguna XS 2.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 57.5 | |
| 168 | Gemma 3 27B PT | not supported · NoCoT-Bench no-chain-of-thought ask | 57.5 | |
| 169 | Claude 3 Haiku | not supported · NoCoT-Bench no-chain-of-thought ask | 57.3 | |
| 170 | Mistral Small 3 24B Base 2501 | not supported · NoCoT-Bench no-chain-of-thought ask | 56.2 | |
| 171 | Qwen3-VL-8B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 56.0 | |
| 172 | GLM 4.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 55.9 | |
| 173 | GPT-4o Mini | not supported · NoCoT-Bench no-chain-of-thought ask | 55.7 | |
| 174 | Mistral Small 3 24B Instruct 2501 | not supported · NoCoT-Bench no-chain-of-thought ask | 55.4 | |
| 175 | GPT-3.5 Turbo 0125 | not supported · NoCoT-Bench no-chain-of-thought ask | 55.2 | |
| 176 | Mercury 2 | disabled · NoCoT-Bench no-chain-of-thought ask | 55.1 | |
| 177 | Qwen3 14B | disabled · NoCoT-Bench no-chain-of-thought ask | 55.0 | |
| 178 | Gemma 3 27B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 54.8 | |
| 179 | Olmo 3.1 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 54.3 | |
| 180 | Nemotron 3.5 Lightning 30B A3B (precision unspecified) | disabled · NoCoT-Bench no-chain-of-thought ask | 54.1 | |
| 181 | Mistral Small 3.2 24B Instruct 2506 | not supported · NoCoT-Bench no-chain-of-thought ask | 53.8 | |
| 182 | Gemma 2 27B | not supported · NoCoT-Bench no-chain-of-thought ask | 53.3 | |
| 183 | Gemma 2 27B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 52.6 | |
| 184 | Qwen1.5 110B Chat | not supported · NoCoT-Bench no-chain-of-thought ask | 52.6 | |
| 185 | Qwen3.5-9B | disabled · NoCoT-Bench no-chain-of-thought ask | 52.4 | |
| 186 | gpt-oss-20b | disabled · NoCoT-Bench no-chain-of-thought ask | 51.5 | |
| 187 | Qwen3 8B | disabled · NoCoT-Bench no-chain-of-thought ask | 51.4 | |
| 188 | Ministral 3 8B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 51.0 | |
| 189 | GPT-5 Mini | disabled · NoCoT-Bench no-chain-of-thought ask | 50.7 | |
| 190 | Gemma 4 E4B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 50.6 | |
| 191 | Qwen3-30B-A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 50.4 | |
| 192 | GPT-4.1 Nano | not supported · NoCoT-Bench no-chain-of-thought ask | 50.2 | |
| 193 | Gemma 3 12B PT | not supported · NoCoT-Bench no-chain-of-thought ask | 49.9 | |
| 194 | Qwen1.5 72B Chat | not supported · NoCoT-Bench no-chain-of-thought ask | 49.7 | |
| 195 | GPT-3.5 Turbo Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 49.6 | |
| 196 | GPT-5.4 Nano | disabled · NoCoT-Bench no-chain-of-thought ask | 49.4 | |
| 197 | Hunyuan A13B Instruct | disabled · NoCoT-Bench no-chain-of-thought ask | 48.7 | |
| 198 | Qwen2.5 7B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 48.4 | |
| 199 | Gemma 2 9B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 47.5 | |
| 200 | Nemotron 3 Nano 30B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 47.3 | |
| 201 | Gemma 3 12B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 46.8 | |
| 202 | Ministral 3 3B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 46.2 | |
| 203 | Gemma 2 9B | not supported · NoCoT-Bench no-chain-of-thought ask | 44.7 | |
| 204 | Qwen3.5-4B | disabled · NoCoT-Bench no-chain-of-thought ask | 44.3 | |
| 205 | Gemma 4 E2B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 44.0 | |
| 206 | Mistral NeMo Base 2407 | not supported · NoCoT-Bench no-chain-of-thought ask | 43.2 | |
| 207 | Mistral NeMo Instruct 2407 | not supported · NoCoT-Bench no-chain-of-thought ask | 42.5 | |
| 208 | Llama 3.1 8B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 41.6 | |
| 209 | Llama 2 70B | not supported · NoCoT-Bench no-chain-of-thought ask | 40.7 | |
| 210 | L3 8B Lunaris v1 | not supported · NoCoT-Bench no-chain-of-thought ask | 40.7 | |
| 211 | Llama 3.1 8B | not supported · NoCoT-Bench no-chain-of-thought ask | 40.6 | |
| 212 | Llama 3 8B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 39.2 | |
| 213 | Gemma 3n E4B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 38.5 | |
| 214 | Gemma 3 4B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 37.9 | |
| 215 | LLaMA 65B | not supported · NoCoT-Bench no-chain-of-thought ask | 37.5 | |
| 216 | Aion-RP 1.0 (8B) | not supported · NoCoT-Bench no-chain-of-thought ask | 37.2 | |
| 217 | Qwen3.5-2B | disabled · NoCoT-Bench no-chain-of-thought ask | 35.5 | |
| 218 | GPT-5 Nano | disabled · NoCoT-Bench no-chain-of-thought ask | 31.0 | |
| 219 | Gemma 7B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 25.8 | |
| 220 | Qwen3.5-0.8B | disabled · NoCoT-Bench no-chain-of-thought ask | 24.9 | |
| 221 | Gemma 2 2B | not supported · NoCoT-Bench no-chain-of-thought ask | 24.3 | |
| 222 | Gemma 2 2B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 24.1 | |
| 223 | MythoMax L2 13B | not supported · NoCoT-Bench no-chain-of-thought ask | 23.8 | |
| 224 | Llama 2 7B | not supported · NoCoT-Bench no-chain-of-thought ask | 18.7 | |
| 225 | Gemma 3 1B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 16.1 | |
| 226 | LLaMA 7B | not supported · NoCoT-Bench no-chain-of-thought ask | 15.0 | |
| 227 | Gemma 2B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 11.9 | |
| 228 | Gemma 3 270M IT | not supported · NoCoT-Bench no-chain-of-thought ask | -23.1 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).