SWE-Lancer Diamond - IC SWE (payout earned)
Code · 2025-02-18
SWE-Lancer turns real Upwork freelance software-engineering jobs into end-to-end-tested tasks priced at their original payouts. This row is the public Diamond split of individual-contributor (IC SWE) implementation tasks, scored as the total dollar payout of the tasks the model solves. Higher is better.
Top models (higher is better)
| Model | Score |
|---|---|
| GPT-5 | 112000 |
| GPT-5 Mini | 75000 |
| GPT-5 Nano | 49000 |
| o1 (2024-12-17) | 43958 |
| GPT-4.1 | 34000 |
| o3-mini | 33833 |
| GPT-4.1 Mini | 31000 |
| GPT-4.1 Nano | 9000 |