BankerToolBench Pass Rate
Professional Work · 2026-04-13
Share of BankerToolBench v1.0's 100 tasks whose deliverable scores above the 0.80 rubric-score threshold that the authors calibrated against bankers' ratings of 'needs light edits' or 'sendable as-is', averaged over three runs (Pass@1). It is a component of the v1.0 factor group, derived from the same graded runs as the rubric Score.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5.4 | 16.0 |
| Gemini 3.1 Pro Preview | 10.0 |
| Opus 4.6 | 9.0 |
| Opus 4.5 | 8.0 |
| GPT-5.2 | 8.0 |
| Qwen3.5 397B A17B | 4.0 |
| GLM-5 | 2.0 |
| Grok 4 | 1.0 |
| Gemini 2.5 Pro | 0.0 |