Vending-Bench (minimum units sold)

Name: Vending-Bench (minimum units sold)
Published: 2025-02-20

Games · 2025-02-20

Minimum units sold across repeated runs in the original Vending-Bench long-horizon vending business simulation.

Model	Score
Grok 4	3515
Gemini 3 Pro Preview	3165
Sonnet 4.5	1907
GPT-5	1798
Opus 4	1218
GPT-5.1	1166
Human (Vending-Bench)	344
gpt-oss-120b	338
o3	331
Gemini 2.5 Pro Preview 03-25	313
Gemini 2.0 Pro Experimental	118
GPT-4o (source unspecified)	108
Gemini Robotics-ER 1.5	75.0
GPT-5 Mini	72.0
GPT-4o Mini	65.0
Claude 3.5 Sonnet (Oct 2024)	0.0
Qwen3-235B-A22B	0.0
Sonnet 4	0.0
Claude 3.7 Sonnet	0.0
o3-mini	0.0
Gemini 1.5 Pro (source unspecified)	0.0
Gemini 1.5 Flash (source unspecified)	0.0
Haiku 3.5	0.0
Gemini 2.0 Flash	0.0
Llama 4 Maverick Instruct	0.0
Kimi K2 Thinking	0.0