Skip to content

Benchmark

Vals MGSM

Math benchmarks measure how well models solve maths problems. Scores are percentages.

Models measured
62
Scores recorded
67
Sources
1
IQ weight
2.55

Score distribution

88.8%
Mean
90.8%
Median
7.4%
Std dev
85.7%
10th percentile
93.3%
90th percentile
41.7%
Min
41.7%95.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.55 for chat models, measured over 62 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 51–67 of 67 results.