LisanBench Path Length
Games · 2025-05-30
LisanBench Path Length sums each model's valid edit-distance-one word-chain transitions across 50 starting words after averaging the three trials for each word. Chains must begin with the required word, use dictionary words, and never repeat a word.
Top models (higher is better)
| Model | Score |
|---|---|
| Muse Wonder Full | 32190 |
| Muse Wonder | 27973 |
| Claude Opus 5.5 | 24029 |
| DeepSeek V4.1 Flash 1017 | 21107 |
| Claude Opus 5 | 15428 |
| Claude Fable 5.1 | 15100 |
| Opus 4.7 | 14400 |
| Opus 4.6 | 14206 |
| Claude Sonnet 5.5 | 13787 |
| Claude Fable 5 | 13680 |
| Claude Haiku 5.5 | 12897 |
| Sonnet 4.6 | 12060 |
| Kimi K3 | 10521 |
| GPT-5.5 | 9845 |
| Opus 4.8 | 9463 |
| GPT-6.1 Sol | 8736 |
| GPT-6 Sol | 8222 |
| Gemini 4 Argon | 7560 |
| GPT-6 Astra | 7393 |
| Gemini 3.1 Pro Preview | 6445 |
| Sonnet 5 | 5724 |
| Opus 4.5 | 5513 |
| GPT-5.4 | 5335 |
| DeepSeek-V3.2-Speciale | 5073 |
| GPT-5.6 Sol | 4699 |
| Gemini 3 Pro Preview | 4677 |
| GPT-5.6 Luna | 4181 |
| Gemini 3.5 Flash | 4123 |
| Grok 4 | 4042 |
| GPT-6 Luna | 3864 |
| Grok 4.20 | 3856 |
| GPT-5.2 | 3592 |
| o3 | 3309 |
| GPT-5.6 Terra | 3303 |
| DeepSeek-V4-Pro | 3256 |
| DeepSeek-V4-Flash | 2789 |
| Grok 4 Fast | 2750 |
| Sonnet 4.5 | 2665 |
| Step 3.5 Flash | 2410 |
| DeepSeek-V3.2 | 2348 |