Benchmarks
347 sources · 1,258 models × 3,038 benchmarks · 158,912 scoresThe knowledge half of Neel Nanda's NoCoT-Bench: NCKI is a Rasch ability over the kspine_v3 knowledge rungs, built from seven long-tail knowledge bank files (1,508 scored items on obscure Wikipedia subjects, arXiv first authors, Python-ecosystem internals, scientific constants and US case law) that models must recall with no chain of thought, under the same witnessed recipes as NCRI. The authors re-anchored its gauge (106.789 + 14.161401·θ) so that the sealed models' mean and spread match the previous spine's, which ties the scale to that cohort of models; it is unbounded and diagnostic.
No signal or difficulty estimate. Held out of the fit by design.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | GPT-6 Astra | disabled · NoCoT-Bench no-chain-of-thought ask | 131 | |
| 2 | GPT-6.1 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 130 | |
| 3 | Gemini 4 Argon | disabled · NoCoT-Bench no-chain-of-thought ask | 128 | |
| 4 | Claude Fable 5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 128 | |
| 5 | Claude Fable 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 128 | |
| 6 | Gemini 3.1 Pro Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 121 | |
| 7 | Gemini 3.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 121 | |
| 8 | Gemini 3.8 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 121 | |
| 9 | GPT-5.6 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 121 | |
| 10 | Claude Opus 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 119 | |
| 11 | GPT-6 Sol | disabled · NoCoT-Bench no-chain-of-thought ask | 119 | |
| 12 | Opus 4.7 | disabled · NoCoT-Bench no-chain-of-thought ask | 118 | |
| 13 | Opus 4.8 | disabled · NoCoT-Bench no-chain-of-thought ask | 117 | |
| 14 | Kimi K3.1 Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 116 | |
| 15 | Gemini 3.5 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 116 | |
| 16 | Gemini 3 Flash Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 115 | |
| 17 | Gemini 3.6 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 115 | |
| 18 | DeepSeek V4 Pro 0813 | disabled · NoCoT-Bench no-chain-of-thought ask | 114 | |
| 19 | Muse Spark 1.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 114 | |
| 20 | Muse Spark 1.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 113 | |
| 21 | Muse Spark 1.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 113 | |
| 22 | Opus 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 112 | |
| 23 | Opus 4.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 112 | |
| 24 | Grok 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 112 | |
| 25 | Muse Spark Open | disabled · NoCoT-Bench no-chain-of-thought ask | 111 | |
| 26 | Hy4 | disabled · NoCoT-Bench no-chain-of-thought ask | 111 | |
| 27 | Opus 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 111 | |
| 28 | GPT-5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 111 | |
| 29 | Kimi K3 | disabled · NoCoT-Bench no-chain-of-thought ask | 110 | |
| 30 | GPT-6.1 Terra | disabled · NoCoT-Bench no-chain-of-thought ask | 110 | |
| 31 | Muse Wonder | disabled · NoCoT-Bench no-chain-of-thought ask | 109 | |
| 32 | Opus 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 109 | |
| 33 | GPT-5.4 | disabled · NoCoT-Bench no-chain-of-thought ask | 108 | |
| 34 | Grok 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 107 | |
| 35 | Claude Sonnet 5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 107 | |
| 36 | Hermes 3 Llama 3.1 405B | not supported · NoCoT-Bench no-chain-of-thought ask | 106 | |
| 37 | Gemini 2.5 Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 105 | |
| 38 | Hy4 Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 104 | |
| 39 | DeepSeek-V4-Flash-Base | not supported · NoCoT-Bench no-chain-of-thought ask | 104 | |
| 40 | GPT-5.6 Terra | disabled · NoCoT-Bench no-chain-of-thought ask | 104 | |
| 41 | Hermes 4 405B | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 42 | Grok 4.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 43 | Sonnet 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 44 | GPT-4.1 | not supported · NoCoT-Bench no-chain-of-thought ask | 103 | |
| 45 | Sonnet 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 102 | |
| 46 | DeepSeek V4.1 Flash 1017 | disabled · NoCoT-Bench no-chain-of-thought ask | 102 | |
| 47 | GPT-5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 101 | |
| 48 | Sonnet 5 | disabled · NoCoT-Bench no-chain-of-thought ask | 101 | |
| 49 | LongCat-2.0 | disabled · NoCoT-Bench no-chain-of-thought ask | 101 | |
| 50 | GPT-5.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 99.9 | |
| 51 | Sonnet 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 99.4 | |
| 52 | Inkling | disabled · NoCoT-Bench no-chain-of-thought ask | 99.1 | |
| 53 | Kimi K2.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 98.7 | |
| 54 | Gemini 3.5 Flash-Lite | disabled · NoCoT-Bench no-chain-of-thought ask | 98.6 | |
| 55 | GPT-4o (2024-05-13) | not supported · NoCoT-Bench no-chain-of-thought ask | 97.6 | |
| 56 | DeepSeek-V3.1-Terminus | disabled · NoCoT-Bench no-chain-of-thought ask | 97.6 | |
| 57 | GPT-4o (2024-11-20) | not supported · NoCoT-Bench no-chain-of-thought ask | 97.6 | |
| 58 | Qwen3.6-Max-Preview | disabled · NoCoT-Bench no-chain-of-thought ask | 97.4 | |
| 59 | DeepSeek-V3.2-Exp | disabled · NoCoT-Bench no-chain-of-thought ask | 97.3 | |
| 60 | GPT-5 | disabled · NoCoT-Bench no-chain-of-thought ask | 97.2 | |
| 61 | DeepSeek-V3.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 97.1 | |
| 62 | Qwen3.8 2.4T A95B | disabled · NoCoT-Bench no-chain-of-thought ask | 96.8 | |
| 63 | GPT-4o (2024-08-06) | not supported · NoCoT-Bench no-chain-of-thought ask | 96.6 | |
| 64 | MiMo-V2.5-Pro | disabled · NoCoT-Bench no-chain-of-thought ask | 96.5 | |
| 65 | Grok 4.20 | disabled · NoCoT-Bench no-chain-of-thought ask | 96.0 | |
| 66 | WizardLM-2 8x22B | not supported · NoCoT-Bench no-chain-of-thought ask | 96.0 | |
| 67 | Kimi K2 Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 95.9 | |
| 68 | GPT-5.3-Codex | disabled · NoCoT-Bench no-chain-of-thought ask | 95.8 | |
| 69 | Nemotron 3 Ultra 550B A55B | disabled · NoCoT-Bench no-chain-of-thought ask | 95.3 | |
| 70 | Llama 3.1 70B | not supported · NoCoT-Bench no-chain-of-thought ask | 95.2 | |
| 71 | Beam 1.0 501B A23B | disabled · NoCoT-Bench no-chain-of-thought ask | 95.2 | |
| 72 | Gemini 2.5 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 95.1 | |
| 73 | DeepSeek-V3.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 95.0 | |
| 74 | Kimi K2.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 94.7 | |
| 75 | Hy3 preview | disabled · NoCoT-Bench no-chain-of-thought ask | 94.6 | |
| 76 | GLM-5.2 | disabled · NoCoT-Bench no-chain-of-thought ask | 94.3 | |
| 77 | Llama 4 Maverick Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 94.2 | |
| 78 | Qwen3 Max Thinking (2026-01-23) | disabled · NoCoT-Bench no-chain-of-thought ask | 94.2 | |
| 79 | DeepSeek-V3-0324 | not supported · NoCoT-Bench no-chain-of-thought ask | 94.0 | |
| 80 | GPT-6 Luna | disabled · NoCoT-Bench no-chain-of-thought ask | 93.8 | |
| 81 | GLM-5 | disabled · NoCoT-Bench no-chain-of-thought ask | 93.3 | |
| 82 | Hy3 | disabled · NoCoT-Bench no-chain-of-thought ask | 93.2 | |
| 83 | DeepSeek-V3 | not supported · NoCoT-Bench no-chain-of-thought ask | 93.1 | |
| 84 | DeepSeek-V4-Flash-0731 | disabled · NoCoT-Bench no-chain-of-thought ask | 92.7 | |
| 85 | GPT-4.1 Mini | not supported · NoCoT-Bench no-chain-of-thought ask | 92.7 | |
| 86 | GLM-5.3 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 92.4 | |
| 87 | GPT-4 Turbo | not supported · NoCoT-Bench no-chain-of-thought ask | 92.4 | |
| 88 | GLM-5.3 | disabled · NoCoT-Bench no-chain-of-thought ask | 92.4 | |
| 89 | Qwen3.5 397B A17B | disabled · NoCoT-Bench no-chain-of-thought ask | 91.7 | |
| 90 | Qwen3.6 Plus (2026-04-02) | disabled · NoCoT-Bench no-chain-of-thought ask | 91.7 | |
| 91 | GLM-4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 91.6 | |
| 92 | Mercury 3 | disabled · NoCoT-Bench no-chain-of-thought ask | 91.5 | |
| 93 | Qwen3.5 Plus (2026-02-15) | disabled · NoCoT-Bench no-chain-of-thought ask | 91.1 | |
| 94 | GPT-4 0613 | not supported · NoCoT-Bench no-chain-of-thought ask | 90.4 | |
| 95 | Ling 2.6 1T | not supported · NoCoT-Bench no-chain-of-thought ask | 89.7 | |
| 96 | ERNIE 4.5 VL 424B A47B | disabled · NoCoT-Bench no-chain-of-thought ask | 89.6 | |
| 97 | GLM-5.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 89.0 | |
| 98 | GLM-4.7 | disabled · NoCoT-Bench no-chain-of-thought ask | 88.8 | |
| 99 | Mistral Small 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 88.0 | |
| 100 | MiniMax M3 | disabled · NoCoT-Bench no-chain-of-thought ask | 87.9 | |
| 101 | GPT-5.6 Luna | disabled · NoCoT-Bench no-chain-of-thought ask | 87.7 | |
| 102 | KAT-Coder-Pro V2 | not supported · NoCoT-Bench no-chain-of-thought ask | 87.2 | |
| 103 | L3.3-70B-Euryale-v2.3 | not supported · NoCoT-Bench no-chain-of-thought ask | 87.2 | |
| 104 | Claude Haiku 5.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 85.9 | |
| 105 | Hermes 4 70B | disabled · NoCoT-Bench no-chain-of-thought ask | 85.8 | |
| 106 | Llama 3.3 70B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 85.8 | |
| 107 | GLM 4.6 | disabled · NoCoT-Bench no-chain-of-thought ask | 85.8 | |
| 108 | Haiku 4.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 84.7 | |
| 109 | Llama 3.1 70B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 84.6 | |
| 110 | Mistral Medium 3.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 83.8 | |
| 111 | Qwen3 235B A22B Instruct 2507 | not supported · NoCoT-Bench no-chain-of-thought ask | 83.4 | |
| 112 | Qwen3-VL-235B-A22B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 83.3 | |
| 113 | Ling 3.0 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 83.2 | |
| 114 | MiMo-V2.5 | disabled · NoCoT-Bench no-chain-of-thought ask | 82.8 | |
| 115 | Claude 3 Haiku | not supported · NoCoT-Bench no-chain-of-thought ask | 82.3 | |
| 116 | GPT-5.4 Mini | disabled · NoCoT-Bench no-chain-of-thought ask | 82.2 | |
| 117 | Qwen3-Coder-480B-A35B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 80.0 | |
| 118 | Qwen3.8 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 79.8 | |
| 119 | MiniMax M2.5 | always on · NoCoT-Bench no-chain-of-thought ask | 79.4 | |
| 120 | Qwen3.5 Plus 2026-04-20 | disabled · NoCoT-Bench no-chain-of-thought ask | 79.0 | |
| 121 | Qwen3-235B-A22B | disabled · NoCoT-Bench no-chain-of-thought ask | 78.7 | |
| 122 | Nemotron 3 Super 120B A12B | disabled · NoCoT-Bench no-chain-of-thought ask | 78.3 | |
| 123 | Qwen3.5 122B A10B | disabled · NoCoT-Bench no-chain-of-thought ask | 78.1 | |
| 124 | GLM-4.5V | disabled · NoCoT-Bench no-chain-of-thought ask | 77.9 | |
| 125 | GPT-3.5 Turbo 0125 | not supported · NoCoT-Bench no-chain-of-thought ask | 77.7 | |
| 126 | Gemma 4 31B | not supported · NoCoT-Bench no-chain-of-thought ask | 77.7 | |
| 127 | Qwen2.5 72B | not supported · NoCoT-Bench no-chain-of-thought ask | 77.5 | |
| 128 | Mistral Small 3 24B Base 2501 | not supported · NoCoT-Bench no-chain-of-thought ask | 77.2 | |
| 129 | GLM-4.6V | disabled · NoCoT-Bench no-chain-of-thought ask | 76.8 | |
| 130 | Qwen3 235B A22B Thinking 2507 | always on · NoCoT-Bench no-chain-of-thought ask | 76.8 | |
| 131 | Qwen3 Next 80B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 76.7 | |
| 132 | Qwen3-Next-80B-A3B-Thinking | always on · NoCoT-Bench no-chain-of-thought ask | 76.5 | |
| 133 | Muse Glimmer 30B | disabled · NoCoT-Bench no-chain-of-thought ask | 76.2 | |
| 134 | GLM 4.5 Air | disabled · NoCoT-Bench no-chain-of-thought ask | 76.0 | |
| 135 | Qwen2.5 72B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 75.9 | |
| 136 | Ling 2.6 Flash | not supported · NoCoT-Bench no-chain-of-thought ask | 75.8 | |
| 137 | MiniMax M2.7 | always on · NoCoT-Bench no-chain-of-thought ask | 75.6 | |
| 138 | Nova Pro | not supported · NoCoT-Bench no-chain-of-thought ask | 75.0 | |
| 139 | Qwen2.5-VL-72B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 74.6 | |
| 140 | Gemini 2.5 Flash-Lite | disabled · NoCoT-Bench no-chain-of-thought ask | 74.6 | |
| 141 | gpt-oss-120b | disabled · NoCoT-Bench no-chain-of-thought ask | 73.7 | |
| 142 | Qwen1.5 110B Chat | not supported · NoCoT-Bench no-chain-of-thought ask | 73.2 | |
| 143 | Mistral Small 3 24B Instruct 2501 | not supported · NoCoT-Bench no-chain-of-thought ask | 73.2 | |
| 144 | Gemma 3 27B PT | not supported · NoCoT-Bench no-chain-of-thought ask | 73.0 | |
| 145 | Solar Pro 4 | disabled · NoCoT-Bench no-chain-of-thought ask | 73.0 | |
| 146 | GPT-5 Mini | disabled · NoCoT-Bench no-chain-of-thought ask | 72.4 | |
| 147 | Llama 2 70B | not supported · NoCoT-Bench no-chain-of-thought ask | 71.3 | |
| 148 | Gemma 2 27B | not supported · NoCoT-Bench no-chain-of-thought ask | 71.1 | |
| 149 | Qwen3.6 27B | disabled · NoCoT-Bench no-chain-of-thought ask | 70.3 | |
| 150 | Qwen3-Coder-Next | not supported · NoCoT-Bench no-chain-of-thought ask | 70.2 | |
| 151 | Mistral Small 3.2 24B Instruct 2506 | not supported · NoCoT-Bench no-chain-of-thought ask | 70.1 | |
| 152 | GPT-4.1 Nano | not supported · NoCoT-Bench no-chain-of-thought ask | 70.1 | |
| 153 | GPT-4o Mini | not supported · NoCoT-Bench no-chain-of-thought ask | 70.0 | |
| 154 | Qwen3.5-27B | disabled · NoCoT-Bench no-chain-of-thought ask | 69.8 | |
| 155 | Cydonia 24B v4.1 | not supported · NoCoT-Bench no-chain-of-thought ask | 69.6 | |
| 156 | Qwen2 72B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 69.4 | |
| 157 | Qwen3.6 35B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 68.7 | |
| 158 | Llama 4 Scout Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 68.3 | |
| 159 | GPT-3.5 Turbo Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 68.2 | |
| 160 | LLaMA 65B | not supported · NoCoT-Bench no-chain-of-thought ask | 68.0 | |
| 161 | Nemotron 3.5 Lightning 30B A3B (precision unspecified) | disabled · NoCoT-Bench no-chain-of-thought ask | 67.7 | |
| 162 | Qwen2.5 32B | not supported · NoCoT-Bench no-chain-of-thought ask | 67.6 | |
| 163 | Qwen3.5 35B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 67.6 | |
| 164 | Qwen3.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 67.3 | |
| 165 | GLM 4.7 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 66.8 | |
| 166 | Qwen3.5-Flash (2026-02-23) | disabled · NoCoT-Bench no-chain-of-thought ask | 66.8 | |
| 167 | Gemma 3 12B PT | not supported · NoCoT-Bench no-chain-of-thought ask | 66.8 | |
| 168 | Laguna S 2.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 66.7 | |
| 169 | Qwen3 VL 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 66.6 | |
| 170 | Qwen2.5 Instruct 32B | not supported · NoCoT-Bench no-chain-of-thought ask | 66.6 | |
| 171 | GPT-5.4 Nano | disabled · NoCoT-Bench no-chain-of-thought ask | 66.5 | |
| 172 | Llama 3.1 8B | not supported · NoCoT-Bench no-chain-of-thought ask | 66.4 | |
| 173 | Qwen1.5 72B Chat | not supported · NoCoT-Bench no-chain-of-thought ask | 66.4 | |
| 174 | Qwen3.8 27B | disabled · NoCoT-Bench no-chain-of-thought ask | 66.3 | |
| 175 | Mercury 2 | disabled · NoCoT-Bench no-chain-of-thought ask | 66.2 | |
| 176 | Mistral NeMo Base 2407 | not supported · NoCoT-Bench no-chain-of-thought ask | 66.1 | |
| 177 | MiniMax M3.1 Flash | disabled · NoCoT-Bench no-chain-of-thought ask | 65.9 | |
| 178 | Qwen3 30B A3B Instruct 2507 | not supported · NoCoT-Bench no-chain-of-thought ask | 65.7 | |
| 179 | Qwen3 VL 30B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 65.4 | |
| 180 | Ripple-65B Preview | unknown · NoCoT-Bench no-chain-of-thought ask | 65.1 | |
| 181 | Phi-4 | not supported · NoCoT-Bench no-chain-of-thought ask | 64.5 | |
| 182 | Llama 3.1 8B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 64.1 | |
| 183 | Ministral 3 14B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 64.1 | |
| 184 | Qwen2.5 Coder 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 63.5 | |
| 185 | Qwen3 32B | disabled · NoCoT-Bench no-chain-of-thought ask | 63.3 | |
| 186 | Gemma 2 27B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 63.2 | |
| 187 | Gemma 3 27B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 62.6 | |
| 188 | Aion-RP 1.0 (8B) | not supported · NoCoT-Bench no-chain-of-thought ask | 62.3 | |
| 189 | Qwen3 Coder 30B A3B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 61.9 | |
| 190 | Llama 3 8B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 61.7 | |
| 191 | Gemma 4 31B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 61.6 | |
| 192 | Mistral NeMo Instruct 2407 | not supported · NoCoT-Bench no-chain-of-thought ask | 61.5 | |
| 193 | Laguna XS 2.1 | disabled · NoCoT-Bench no-chain-of-thought ask | 61.0 | |
| 194 | Gemma 2 9B | not supported · NoCoT-Bench no-chain-of-thought ask | 60.3 | |
| 195 | gpt-oss-20b | disabled · NoCoT-Bench no-chain-of-thought ask | 60.2 | |
| 196 | Qwen3-30B-A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 60.0 | |
| 197 | L3 8B Lunaris v1 | not supported · NoCoT-Bench no-chain-of-thought ask | 59.8 | |
| 198 | Gemma 4 26B A4B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 59.3 | |
| 199 | Ministral 3 8B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 58.3 | |
| 200 | Olmo 3.1 32B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 57.5 | |
| 201 | Qwen3.5-9B | disabled · NoCoT-Bench no-chain-of-thought ask | 56.6 | |
| 202 | Gemma 2 9B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 56.0 | |
| 203 | Qwen3-VL-8B-Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 55.9 | |
| 204 | Qwen3 14B | disabled · NoCoT-Bench no-chain-of-thought ask | 54.7 | |
| 205 | Qwen3 8B | disabled · NoCoT-Bench no-chain-of-thought ask | 53.8 | |
| 206 | Nemotron 3 Nano 30B A3B | disabled · NoCoT-Bench no-chain-of-thought ask | 53.5 | |
| 207 | Qwen3.5-4B | disabled · NoCoT-Bench no-chain-of-thought ask | 51.3 | |
| 208 | Qwen2.5 7B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 51.0 | |
| 209 | MythoMax L2 13B | not supported · NoCoT-Bench no-chain-of-thought ask | 50.1 | |
| 210 | Gemma 4 12B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 49.8 | |
| 211 | Gemma 3 12B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 49.6 | |
| 212 | GPT-5 Nano | disabled · NoCoT-Bench no-chain-of-thought ask | 49.2 | |
| 213 | LLaMA 7B | not supported · NoCoT-Bench no-chain-of-thought ask | 47.3 | |
| 214 | Llama 2 7B | not supported · NoCoT-Bench no-chain-of-thought ask | 46.5 | |
| 215 | Ministral 3 3B Instruct 2512 | not supported · NoCoT-Bench no-chain-of-thought ask | 46.2 | |
| 216 | Gemma 4 E4B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 45.8 | |
| 217 | Hunyuan A13B Instruct | disabled · NoCoT-Bench no-chain-of-thought ask | 43.6 | |
| 218 | Gemma 3 4B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 39.9 | |
| 219 | Gemma 2 2B | not supported · NoCoT-Bench no-chain-of-thought ask | 39.1 | |
| 220 | Gemma 3n E4B Instruct | not supported · NoCoT-Bench no-chain-of-thought ask | 37.6 | |
| 221 | Gemma 2 2B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 36.9 | |
| 222 | Gemma 4 E2B IT | disabled · NoCoT-Bench no-chain-of-thought ask | 36.4 | |
| 223 | Gemma 7B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 35.0 | |
| 224 | Qwen3.5-2B | disabled · NoCoT-Bench no-chain-of-thought ask | 31.3 | |
| 225 | Qwen3.5-0.8B | disabled · NoCoT-Bench no-chain-of-thought ask | 8.7 | |
| 226 | Gemma 2B IT | not supported · NoCoT-Bench no-chain-of-thought ask | 1.0 | |
| 227 | Gemma 3 1B IT | not supported · NoCoT-Bench no-chain-of-thought ask | -4.5 | |
| 228 | Gemma 3 270M IT | not supported · NoCoT-Bench no-chain-of-thought ask | -13.3 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).