Skip to content

Benchmark

ARC-Easy

Scores are percentages.

Models measured
17
Scores recorded
17
Sources
1
IQ weight
1.55

Score distribution

89%
Mean
93.4%
Median
9.8%
Std dev
74.8%
10th percentile
98.4%
90th percentile
71.2%
Min
71.2%98.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.55 for chat models, measured over 17 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)