Skip to content

Benchmark

TriviaQA

Scores are percentages. Higher is better.

Models and systems measured
27
Scores recorded
27
Sources
3
IQ weight
0.00

Score distribution

74.8%
Mean
76.6%
Median
9.8%
Std dev
64%
10th percentile
83.7%
90th percentile
45.2%
Min
45.2%87.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.00 for chat models, measured over 26 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or systemScore
1Claude 2· Epoch AI Benchmarking Hub data87.5%
2GPT-3.5 Turbo· Epoch AI Benchmarking Hub data85.8%
3GPT 4· Epoch AI Benchmarking Hub data84.8%
4Gemma 2 27B IT· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim83.7%
5DeepSeek V3· Epoch AI Benchmarking Hub data82.9%
6Llama 3.1 405B· Epoch AI Benchmarking Hub data82.7%
7Mixtral 8X7b V0.1· Epoch AI Benchmarking Hub data82.2%
8MiMo V2.5 Pro· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim81.3%
9Mistral Small 3.1 24b Instruct 2503· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim80.5%
10Llama 2 13b· Epoch AI Benchmarking Hub data79.6%
11Claude Instant 1.2· Epoch AI Benchmarking Hub data78.7%
12LLaMA 13B· Epoch AI Benchmarking Hub data77.9%
13Gemma 2 9B IT· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim76.6%
14Mistral 7B v0.1· Epoch AI Benchmarking Hub data75.2%
15Mistral Large 3· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim74.9%
16Phi-3 Medium 128K Instruct· Epoch AI Benchmarking Hub data73.9%
17Mistral Nemo· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim73.8%
18Llama 2 7b· Epoch AI Benchmarking Hub data73.7%
19gemma-7b· Epoch AI Benchmarking Hub data72.3%
20Qwen2.5 72B· Epoch AI Benchmarking Hub data71.9%
21text-davinci-001· Epoch AI Benchmarking Hub data71.2%
22Llama 3 8B Instruct· Epoch AI Benchmarking Hub data67.7%
23Phi-3 Mini 4K Instruct· Epoch AI Benchmarking Hub data64%
24Phi-3 Small 8K Instruct· Epoch AI Benchmarking Hub data58.1%
25gemma-2b· Epoch AI Benchmarking Hub data53.2%
26phi-2· Epoch AI Benchmarking Hub data45.2%

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
MiMo V2 Flash Baseofficial Base table · 5-shot· Reported by Xiaomi MiMo· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.80.3%

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats · BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.