Skip to content

Benchmark

MMLU (CoT)

Scores are percentages. Higher is better.

Models measured
3
Scores recorded
3
Sources
1
IQ weight
No weight published

Score distribution

82.5%
Mean
86%
Median
6.8%
Std dev
73%
10th percentile
88.6%
90th percentile
73%
Min
73%88.6%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Llama 3.1 405B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim88.6%
2Llama 3.1 70B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim86%
3Llama 3.1 8B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim73%

Data credits: Data by LLM Stats