FinanceQA - Assumption-Based
Professional Work · 2025-01-29
The assumption-based FinanceQA component contains 46 tactical financial-analysis questions where information is incomplete and the model must make logical, defensible assumptions while following professional accounting and valuation conventions. The AfterQuery FinanceArena leaderboard reports accuracy on this component. Reported scores land off the 46-item lattice (fine-grained decimals), indicating partial credit or run averaging, so the reported number is a mean of per-item scores and a binomial noise model is not licensed.
Top models (higher is better)
| Model | Score |
|---|---|
| o3 | 21.7 |
| Opus 4 | 13.0 |
| Grok 4 | 10.9 |
| QwQ-32B | 10.9 |
| GPT-4.1 Mini | 10.9 |
| O4 Mini | 8.7 |
| Llama 4 Maverick Instruct | 8.7 |
| Grok 3 (API) | 8.7 |
| Phi-4-reasoning-plus | 8.7 |
| Gemini 2.5 Pro | 6.5 |
| Sonnet 4 | 6.5 |
| DeepSeek-R1-0528 | 6.5 |
| Kimi K2 Instruct | 6.5 |
| Gemini 2.5 Flash | 6.5 |
| Command A | 6.5 |
| Llama 3.1 Nemotron Ultra 253B V1 | 4.3 |
| Nova Pro | 4.3 |
| Qwen3-30B-A3B | 2.2 |
| Magistral Medium 1.0 | 0.0 |