Skip to content

Benchmark

AHELM: MUStARD - EM

Scores are percentages.

Models measured
12
Scores recorded
12
Sources
1
IQ weight
1.14

Score distribution

59.6%
Mean
59.3%
Median
3.4%
Std dev
55.8%
10th percentile
65.5%
90th percentile
55.5%
Min
55.5%66.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.14 for chat models, measured over 9 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard