Skip to content

Benchmark

MineBench

People compare model answers and choose which they prefer.

Models measured
80
Scores recorded
80
Sources
1
IQ weight
2.01

Score distribution

1,512.8
Mean
1,543
Median
399.5
Std dev
1,014
10th percentile
2,067
90th percentile
544
Min
5442,169
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.01 for chat models, measured over 80 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 51–80 of 80 results.

Data credits: MineBench, MIT (licence)