Skip to content

Benchmark

LAMBADA

Scores are percentages.

Models measured
5
Scores recorded
5
Sources
1
IQ weight
2.46

Score distribution

73.1%
Mean
75.2%
Median
10.5%
Std dev
54.3%
10th percentile
86.4%
90th percentile
54.3%
Min
54.3%86.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.46 for chat models, measured over 5 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)