Atlas

Benchmarks

← All benchmarks

Codeforces - DeepSeek-reported competitor percentile

Code

Percentile of human Codeforces competitors that a model outperforms, as computed by DeepSeek's internal Codeforces evaluation in its DeepSeek-V3 and DeepSeek-R1 reports (problems from recent Division 2 contests graded with expert-crafted test cases). The contest set and rating procedure are DeepSeek-internal and change between reports, so the row is diagnostic.

Top models (higher is better)

ModelScore
DeepSeek-R196.3
o1-mini93.4
DeepSeek-R1-Distill-Qwen-32B90.6
DeepSeek-R1-Zero80.4
DeepSeek-V2.535.6
Llama 3.1 405B Instruct25.3
Qwen2.5 72B Instruct24.8
GPT-4o (2024-05-13)23.6
Claude 3.5 Sonnet (Oct 2024)20.3
DeepSeek-V2-Chat17.5
Loading Atlas data…