Skip to content

Benchmark

MathArena 06/2026

Math benchmarks measure how well models solve maths problems. Scores are percentages.

Models measured
29
Scores recorded
32
Sources
1
IQ weight
1.25

Score distribution

42.3%
Mean
39.1%
Median
31.3%
Std dev
8.7%
10th percentile
95.4%
90th percentile
0%
Min
0%100%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.25 for chat models, measured over 29 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model
1Claude Opus 5.5high· MathArena data100%
2GPT-6.1 Solmax· MathArena data100%
3GPT-6 Astralow· MathArena data97.7%
4GPT-6 Solmax· MathArena data95.4%
5Claude Fable 5.1max· MathArena data91%
6Claude Fable 5.1low· MathArena data86.6%
7GPT 5.5xhigh· MathArena data69.4%
8GPT-5.6 Solmax· MathArena data67.3%
9GPT-6 Astramax· MathArena data65.2%
10Grok 4.7xhigh· MathArena data52.8%
11Kimi K3max· MathArena data51.9%
12Muse Spark 1.1· MathArena data50.6%
13Qwen3.8 Maxmax· MathArena data45.6%
14Muse Spark Openxhigh· MathArena data42.3%
15DeepSeek V4.1 Flashmax· MathArena data39.4%
16GPT-5.6 Solmax, via Codex· MathArena data39.1%
17Claude Opus 5max· MathArena data32.6%
18Grok 4.5high· MathArena data29.3%
19Muse Spark 1.3max· MathArena data28.3%
20Claude Opus 4.8max· MathArena data23.9%
21Mistral Large 4high· MathArena data22.2%
22Gemini 3.7 Flashhigh· MathArena data21.7%
23Gemini 3.8 Flashhigh· MathArena data19.6%
24DeepSeek V4 Flashmax· MathArena data16.7%
25Claude Fable 5max· MathArena data15.2%
26Gemini 3.5 Flashhigh· MathArena data12.4%
27Gemini 3.6 Flash· MathArena data12%
28Gemini 3.1 Pro Previewhigh· MathArena data10.9%
29GLM 5.2max· MathArena data8.7%
30Qwen3.6 35B· MathArena data3.4%
31Qwen3.5 2B· MathArena data2.8%
32Step 3.7 Flashhigh· MathArena data0%

Tokens the model generated per task, as measured by the source. Comparable within this benchmark only.

Data credits: MathArena (ETH SRI / INSAIT), MIT — cite dekoninck2026matharena (licence)