Skip to content

Benchmark

WildBench: WB_score.Math & Data Analysis

Math benchmarks measure how well models solve maths problems. Higher scores are better.

Models measured
41
Scores recorded
41
Sources
1
IQ weight
1.45

Score distribution

31.4
Mean
36.4
Median
18.5
Std dev
8.9
10th percentile
51.4
90th percentile
-18.6
Min
-18.657.3
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.45 for chat models, measured over 41 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4oallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data57.3
2Athene 70Ballenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data57.1
3GPT-4o miniallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data54
4Mistral Large 2allenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data52.7
5DeepSeek V2 Chatallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data51.4
6GPT-4 Turboallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data51
7Claude 3.5 Sonnetallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data50.2
8Gemini 1.5 Proallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data48.6
9Gemma 2 9B IT SimPOallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data48.6
10Claude 3 Opusallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data46.7
11GPT-4-0125-previewallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data45.8
12Gemini 1.5 Flashallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data45.3
13yi-largeallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data44.5
14Llama 3 70B Instructallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data42.1
15DeepSeek Coder V2 Instructallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data41.6
16Qwen2 72B Instructallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data41
17Nemotron-4 340B Instructallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data40.8
18Claude 3 Sonnetallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data40.6
19Reka Coreallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data40.3
20Yi 1.5 34B Chatallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data39.4
21Gemma 2 9B ITallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data36.4
22Mistral Nemoallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data35.6
23Claude 3 Haikuallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data31.4
24Mistral Largeallenai/WildBench, WB_score.Math & Data Analysis, 2402· WildBench direct data30.9
25GLM-4-9b-chatallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data29.8
26Command R Plusallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data23.5
27Mixtral 8x7B Instruct v0.1allenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data22.1
28Nous Hermes 2 Mixtral 8x7B DPOallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data21.8
29GPT-3.5 Turboallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data21.6
30Reka Flashallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data20.5
31Starling LM 7B Betaallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data17
32Llama 3 8B Instructallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data17
33Command R+allenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data16
34Gemma 2 2B ITallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data15.8
35Tulu 2 DPO 70Ballenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data14.8
36Mistral 7B Instruct v0.2allenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data10.1
37Reka Edgeallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data8.9
38Llama-2-70b-chat-hfallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data4.2
39Gemma 7B ITallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data-3.7
40Llama-2-7b-chat-hfallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data-7.2
41Gemma 2B ITallenai/WildBench, WB_score.Math & Data Analysis· WildBench direct data-18.6

Data credits: WildBench, Allen Institute for AI