Benchmark
Codeforces Rating
Coding benchmarks compare models on programming tasks. Higher scores are better.
- Models measured
- 11
- Scores recorded
- 23
- Sources
- 1
- IQ weight
- 0.78
Score distribution
- 2,400.8
- Mean
- 2,386
- Median
- 632.9
- Std dev
- 1,595
- 10th percentile
- 3,348
- 90th percentile
- 1,251
- Min
This benchmark has a weight of 0.78 for chat models, measured over 11 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | DeepSeek V4.1 FlashDeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3,471 |
| 2 | DeepSeek V4.1 Flashreasoning_effort 100· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3,471 |
| 3 | DeepSeek V4 Pro 0813DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3,348 |
| 4 | DeepSeek V4 Flash 0731DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3,289 |
| 5 | DeepSeek V4 FlashDeepSeek V4 official model card · Think Max· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3,052 |
| 6 | DeepSeek V4 FlashDeepSeek V4 official model card · Think High· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,816 |
| 7 | DeepSeek V3.2 SpecialeSpeciale high-compute reasoning · temperature 1.0 · 128K context · reported rating· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,701 |
| 8 | GPT OSS 120Bofficial model card Table 3 · reasoning high · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,622 |
| 9 | GPT OSS 20bofficial model card Table 3 · reasoning high · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,516 |
| 10 | Step 3.5 FlashStep 3.5 technical report · Table 15 · CF-Div2-Stepfun · pass@8 rating· Reported by StepFun· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,489 |
| 11 | GPT OSS 120Bofficial model card Table 3 · reasoning high · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,463 |
| 12 | DeepSeek V3.2Thinking mode · temperature 1.0 · 128K context · reported rating· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,386 |
| 13 | GPT OSS 120Bofficial model card Table 3 · reasoning medium · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,365 |
| 14 | GPT OSS 20bofficial model card Table 3 · reasoning high · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,230 |
| 15 | GPT OSS 120Bofficial model card Table 3 · reasoning medium · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,205 |
| 16 | Gemma 4 31B ITGemma 4 Technical Report · Table 5 · thinking mode unless noted· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,150 |
| 17 | GPT OSS 20bofficial model card Table 3 · reasoning medium · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2,064 |
| 18 | GPT OSS 20bofficial model card Table 3 · reasoning medium · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,998 |
| 19 | Gemma 4 26B A4BGemma 4 Technical Report · Table 5 · thinking mode unless noted· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,718 |
| 20 | GPT OSS 120Bofficial model card Table 3 · reasoning low · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,653 |
| 21 | GPT OSS 120Bofficial model card Table 3 · reasoning low · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,595 |
| 22 | GPT OSS 20bofficial model card Table 3 · reasoning low · no tools · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,366 |
| 23 | GPT OSS 20bofficial model card Table 3 · reasoning low · with tools; Table 3 does not name the exact tool · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,251 |