Skip to content

Benchmark

OpenBookQA

Scores are percentages.

Models measured
17
Scores recorded
17
Sources
2
IQ weight
0.17

Score distribution

73.5%
Mean
79.2%
Median
15.5%
Std dev
57%
10th percentile
88%
90th percentile
32.4%
Min
32.4%89.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.17 for chat models, measured over 17 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats