Benchmark
WildBench: WB_score.Creative Tasks
People compare model answers and choose which they prefer. Higher scores are better.
- Models measured
- 41
- Scores recorded
- 41
- Sources
- 1
- IQ weight
- 1.53
Score distribution
- 47.8
- Mean
- 51
- Median
- 10.7
- Std dev
- 37.4
- 10th percentile
- 58.7
- 90th percentile
- 7.2
- Min
This benchmark has a weight of 1.53 for chat models, measured over 41 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Athene 70Ballenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 60.4 |
| 2 | GPT-4o miniallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 60.1 |
| 3 | GPT 4oallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 59.1 |
| 4 | Mistral Large 2allenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 58.9 |
| 5 | GPT-4 Turboallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 58.7 |
| 6 | Gemma 2 9B IT SimPOallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 58 |
| 7 | GPT-4-0125-previewallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 57.6 |
| 8 | DeepSeek V2 Chatallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 56.4 |
| 9 | Claude 3.5 Sonnetallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 55.6 |
| 10 | Reka Coreallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 55.5 |
| 11 | Gemini 1.5 Proallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 55.1 |
| 12 | Mistral Nemoallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 54.6 |
| 13 | DeepSeek Coder V2 Instructallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 54.5 |
| 14 | Llama 3 70B Instructallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 54.3 |
| 15 | Yi 1.5 34B Chatallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 53.5 |
| 16 | Nemotron-4 340B Instructallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 53.3 |
| 17 | Claude 3 Opusallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 53 |
| 18 | Command R Plusallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 52.6 |
| 19 | yi-largeallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 51.8 |
| 20 | Gemini 1.5 Flashallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 51.7 |
| 21 | Gemma 2 9B ITallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 51 |
| 22 | Qwen2 72B Instructallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 49.9 |
| 23 | Mistral Largeallenai/WildBench, WB_score.Creative Tasks, 2402· WildBench direct data | 49.7 |
| 24 | GLM-4-9b-chatallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 47.8 |
| 25 | Command R+allenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 47.4 |
| 26 | Claude 3 Sonnetallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 46.3 |
| 27 | Starling LM 7B Betaallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 43.8 |
| 28 | Gemma 2 2B ITallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 43.6 |
| 29 | Llama 3 8B Instructallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 43.6 |
| 30 | Claude 3 Haikuallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 42.9 |
| 31 | Mixtral 8x7B Instruct v0.1allenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 42.8 |
| 32 | Tulu 2 DPO 70Ballenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 42.7 |
| 33 | Reka Flashallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 42.4 |
| 34 | Mistral 7B Instruct v0.2allenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 42.1 |
| 35 | Llama-2-70b-chat-hfallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 40 |
| 36 | Nous Hermes 2 Mixtral 8x7B DPOallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 37.9 |
| 37 | GPT-3.5 Turboallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 37.4 |
| 38 | Reka Edgeallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 36.2 |
| 39 | Llama-2-7b-chat-hfallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 29.8 |
| 40 | Gemma 7B ITallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 21.2 |
| 41 | Gemma 2B ITallenai/WildBench, WB_score.Creative Tasks· WildBench direct data | 7.2 |
Data credits: WildBench, Allen Institute for AI