Skip to content

Benchmark

Natural Questions

Scores are percentages.

Models measured
3
Scores recorded
3
Sources
1
IQ weight
No weight published

Score distribution

31.6%
Mean
31.2%
Median
2.2%
Std dev
29.2%
10th percentile
34.5%
90th percentile
29.2%
Min
29.2%34.5%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Gemma 2 27B IT· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim34.5%
2Mistral Nemo· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim31.2%
3Gemma 2 9B IT· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim29.2%

Data credits: Data by LLM Stats