Arena-Hard-Auto v2.0 - Creative Writing
Chat & Writing · 2025-04-23
The 250 creative-writing prompts of Arena-Hard-Auto v2.0, scored as the estimated win rate in percent against the v2.0 creative-writing baseline under an LLM judge. A component of the Arena-Hard v2.0 family (arena-hard-v2), measured on the same runs as the hard-prompts subset. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| Kimi K2 Instruct | 85.0 |
| Nemotron Cascade 2 30B A3B | 78.7 |
| Opus 4 | 68.5 |
| Qwen3.5 35B A3B | 66.3 |
| Qwen3 30B A3B Thinking 2507 | 66.0 |
| Nemotron 3 Nano 30B A3B | 63.2 |
| GPT-4.1 | 61.5 |
| Qwen3-235B-A22B | 59.8 |
| DeepSeek-V3-0324 | 59.3 |
| Sonnet 4 | 54.6 |
| gpt-oss-20b | 25.9 |