Skip to content

Benchmark

GSM-8K (CoT)

Math benchmarks measure how well models solve maths problems. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

89.8%
Mean
95.1%
Median
5.3%
Std dev
84.5%
10th percentile
95.1%
90th percentile
84.5%
Min
84.5%95.1%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Llama 3.1 70B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim95.1%
2Llama 3.1 8B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim84.5%

Data credits: Data by LLM Stats