Skip to content

Benchmark

LiveCodeBench Pro Easy

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
0.42

Score distribution

73.2%
Mean
85.7%
Median
16.5%
Std dev
53.5%
10th percentile
90.1%
90th percentile
50.7%
Min
50.7%90.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.42 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard