Skip to content

Benchmark

WildBench: gpt4t_reward.Information/Advice seeking.K=-1

People compare model answers and choose which they prefer. Higher scores are better.

Models measured
32
Scores recorded
32
Sources
1
IQ weight
1.38

Score distribution

-32.7
Mean
-27.6
Median
23.2
Std dev
-61.1
10th percentile
0.884
90th percentile
-88.1
Min
-88.111.3
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.38 for chat models, measured over 32 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4oallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data11.3
2Gemini 1.5 Proallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data2.7
3Claude 3.5 Sonnetallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data1.7
4GPT-4-0125-previewallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data0.884
5Yi 1.5 34B Chatallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-10
6Llama 3 70B Instructallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-11.5
7Gemini 1.5 Flashallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-12.9
8yi-largeallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-15.6
9Nemotron-4 340B Instructallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-16
10Claude 3 Opusallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-18.8
11Reka Coreallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-19.9
12GLM-4-9b-chatallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-22.5
13DeepSeek Coder V2 Instructallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-23.3
14Command R Plusallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-26.4
15Claude 3 Sonnetallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-26.6
16Qwen2 72B Instructallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-27.6
17Command R+allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-36
18Llama 3 8B Instructallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-40.1
19Claude 3 Haikuallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-40.8
20Reka Flashallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-41.3
21Starling LM 7B Betaallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-42.5
22Llama-2-70b-chat-hfallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-43.6
23Mistral Largeallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, 2402· WildBench direct data-43.6
24Mixtral 8x7B Instruct v0.1allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-46.9
25Reka Edgeallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-48.5
26Mistral 7B Instruct v0.2allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-49.9
27Tulu 2 DPO 70Ballenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-52.6
28Nous Hermes 2 Mixtral 8x7B DPOallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-55.7
29Llama-2-7b-chat-hfallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-61.1
30GPT-3.5 Turboallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-65.2
31Gemma 7B ITallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-76.9
32Gemma 2B ITallenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09· WildBench direct data-88.1

Data credits: WildBench, Allen Institute for AI