Benchmarks
347 sources · 1,258 models × 3,038 benchmarks · 158,912 scoresCrossSearch's pass@1: the share of all 300 attempts (three on each of 100 tasks) that earn full credit, meaning every rubric item for the task passes under the GPT-6.1 Sol judge. Unlike the pass^3 headline, it credits tasks a model solves only sometimes.
73rd strongest of 798 fitted benchmarks
Signal-to-noise +14.98 for the CrossSearch (pass^3) family
Another benchmark represents this family in the fit.
| # | Model | Setting | Score | Source |
|---|---|---|---|---|
| 1 | Gemini 4 Argon | high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 65,536-token response limit | 72.3 | |
| 2 | GPT-6 Astra | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 71.3 | |
| 3 | Claude Opus 5.5 | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 70.3 | |
| 4 | GPT-6.1 Sol | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 68.0 | |
| 5 | Claude Fable 5.2 | high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 32,768-token response limit | 66.7 | |
| 6 | GPT-5.6 Sol | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 59.0 | |
| 7 | Muse Wonder | high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 32,768-token response limit | 58.3 | |
| 8 | Claude Opus 5 | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 54.3 | |
| 9 | Grok 4.6 | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 450,000-token response limit | 53.3 | |
| 10 | Gemini 3.8 Flash | high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 65,536-token response limit | 45.0 | |
| 11 | Inkling 2 Small | thinking · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 262,144-token response limit; Tinker's 256K-context listing, asked for effort "high", whose numeric setting is undocumented | 44.0 | |
| 12 | Kimi K3 | high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 943,718-token response limit | 32.3 | |
| 13 | Sonnet 5 | x-high · AfterQuery CrossSearch harness: Terminus 2 on Harbor, one shell with live internet, no search tool and a view_image command; three attempts per task; 128,000-token response limit | 27.0 |
Benchmarks outside its family whose model rankings track it most reliably (Spearman ρ over at least 10 shared models).