Skip to content

Benchmark

Codeforces Rating

Coding benchmarks compare models on programming tasks. Higher scores are better.

Models measured
11
Scores recorded
23
Sources
1
IQ weight
0.78

Score distribution

2,400.8
Mean
2,386
Median
632.9
Std dev
1,595
10th percentile
3,348
90th percentile
1,251
Min
1,2513,471
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.78 for chat models, measured over 11 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1DeepSeek V4.1 FlashDeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.3,471
2DeepSeek V4.1 Flashreasoning_effort 100· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.3,471
3DeepSeek V4 Pro 0813DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.3,348
4DeepSeek V4 Flash 0731DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.3,289
5DeepSeek V4 FlashDeepSeek V4 official model card · Think Max· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.3,052
6DeepSeek V4 FlashDeepSeek V4 official model card · Think High· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,816
7DeepSeek V3.2 SpecialeSpeciale high-compute reasoning · temperature 1.0 · 128K context · reported rating· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,701
8GPT OSS 120Bofficial model card Table 3 · reasoning high · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,622
9GPT OSS 20bofficial model card Table 3 · reasoning high · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,516
10Step 3.5 FlashStep 3.5 technical report · Table 15 · CF-Div2-Stepfun · pass@8 rating· Reported by StepFun· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,489
11GPT OSS 120Bofficial model card Table 3 · reasoning high · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,463
12DeepSeek V3.2Thinking mode · temperature 1.0 · 128K context · reported rating· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,386
13GPT OSS 120Bofficial model card Table 3 · reasoning medium · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,365
14GPT OSS 20bofficial model card Table 3 · reasoning high · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,230
15GPT OSS 120Bofficial model card Table 3 · reasoning medium · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,205
16Gemma 4 31B ITGemma 4 Technical Report · Table 5 · thinking mode unless noted· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,150
17GPT OSS 20bofficial model card Table 3 · reasoning medium · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2,064
18GPT OSS 20bofficial model card Table 3 · reasoning medium · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,998
19Gemma 4 26B A4BGemma 4 Technical Report · Table 5 · thinking mode unless noted· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,718
20GPT OSS 120Bofficial model card Table 3 · reasoning low · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,653
21GPT OSS 120Bofficial model card Table 3 · reasoning low · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,595
22GPT OSS 20bofficial model card Table 3 · reasoning low · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,366
23GPT OSS 20bofficial model card Table 3 · reasoning low · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,251

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.