Skip to content

Benchmark

HumanEval-Mul

Coding benchmarks compare models on programming tasks. Scores are percentages. Higher is better.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

78.2%
Mean
82.6%
Median
4.4%
Std dev
73.8%
10th percentile
82.6%
90th percentile
73.8%
Min
73.8%82.6%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1DeepSeek V3· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim82.6%
2DeepSeek V2.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim73.8%

Data credits: Data by LLM Stats