Skip to content

Benchmark

CNMO 2024

Math benchmarks measure how well models solve maths problems. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

58.8%
Mean
74.3%
Median
15.6%
Std dev
43.2%
10th percentile
74.3%
90th percentile
43.2%
Min
43.2%74.3%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Kimi K2 Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim74.3%
2DeepSeek V3· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim43.2%

Data credits: Data by LLM Stats