Atlas

Benchmarks

Vibe Code Bench 1–100 v1.1

Vals' November 2026 revision of Vibe Code Bench 1–100: fifty held-out scenarios, each starting from a working Vibe Code Bench v1.1 web app, with up to ten dependent product requests (456 in all) and a shared ten-hour budget in a modified OpenHands v1 environment with Supabase, Stripe and MailHog. After each request a GPT-6 Luna browser agent runs new and regression workflows, and Claude Sonnet 5.5 reviews its failure verdicts: an iteration fails only on a confirmed implementation issue, and inconclusive reviews pass. Score is the mean fraction of planned iterations passed consecutively before the first failure. v1.1 rewrote v1's iteration prompts to be less ambiguous, audited every workflow assertion and added the failure review, so it is not comparable with vcb-1-100; fifty validation scenarios are excluded.

Models
7
Top score
49.7
Leader
Gemini 4 Carbon
Updated
—
Resolution
—
Saturation
—

No signal or difficulty estimate. Too few models have been measured on this benchmark to estimate its difficulty.

Organizations
7 dated models · 2 frontier modelsClosed weightsOpen weights
Data: Vals AIatlas.village.dev

Vibe Code Bench 1–100 v1.1 leaderboard

Related benchmarks

Loading Atlas data…