Skip to content
Models measured
158
Scores recorded
161
Sources
2
IQ weight
1.50

Score distribution

10.7%
Mean
10.2%
Median
7.7%
Std dev
3%
10th percentile
17.2%
90th percentile
0.456%
Min
0.456%76.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.50 for chat models, measured over 158 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Kimi K2 Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim76.4%
2DeepSeek R1 Distill Qwen 14B· Hugging Face Open LLM Leaderboard data28.7%
3DeepSeek LLM 67B Chat· Hugging Face Open LLM Leaderboard data23.9%
4arcee-blitz· Hugging Face Open LLM Leaderboard data23.8%
5Phi 4· Hugging Face Open LLM Leaderboard data23.7%
6Hermes 3 Llama 3.1 70B· Hugging Face Open LLM Leaderboard data23.4%
7Qwen2.5 32B· Hugging Face Open LLM Leaderboard data22.7%
8L3.3 Nevoria R1 70b· Hugging Face Open LLM Leaderboard data20.2%
9EVA-Qwen2.5-72B-v0.2· Hugging Face Open LLM Leaderboard data19.7%
10Qwen 2 (72B)· Hugging Face Open LLM Leaderboard data19.7%
11Qwen2.5 72B· Hugging Face Open LLM Leaderboard data19.6%
12Granite 3.1 8B Instruct· Hugging Face Open LLM Leaderboard data19%
13L3.3 Ms Nevoria 70b· Hugging Face Open LLM Leaderboard data18.6%
14Llama 3.1 70B Instruct· Hugging Face Open LLM Leaderboard data17.7%
15phi-3.5-moe-instruct· Hugging Face Open LLM Leaderboard data17.3%
16Mistral Large Instruct 2411· Hugging Face Open LLM Leaderboard data17.2%
17Qwen2 72B Instruct· Hugging Face Open LLM Leaderboard data17.2%
18dolphin-2-9-2-qwen2-72b· Hugging Face Open LLM Leaderboard data17%
19Yi-6B200k· Hugging Face Open LLM Leaderboard data16.8%
20Qwen2 72B Dracarys· Hugging Face Open LLM Leaderboard data16.8%
21Granite 3.2 8b Instruct· Hugging Face Open LLM Leaderboard data16.8%
22Phi-3 Small 8K Instruct· Hugging Face Open LLM Leaderboard data16.8%
23Nous Hermes 2 Mixtral 8x7B DPO· Hugging Face Open LLM Leaderboard data16.7%
24Llama 3.1 70B· Hugging Face Open LLM Leaderboard data16.6%
25Qwen2.5 Math 72B Instruct· Hugging Face Open LLM Leaderboard data16.3%
26internlm2-5-7b-chat· Hugging Face Open LLM Leaderboard data16.3%
27Qwen1.5-110B-Chat· Hugging Face Open LLM Leaderboard data16.3%
28DeepSeek R1 Distill Qwen 32B· Hugging Face Open LLM Leaderboard data16.1%
29OpenHermes-2-Mistral-7B· Hugging Face Open LLM Leaderboard data16.1%
30Meta Llama 3 70b· Hugging Face Open LLM Leaderboard data16%
31DeepHermes 3 Mistral 24B Preview· Hugging Face Open LLM Leaderboard data16%
32Qwen2.5 14B· Hugging Face Open LLM Leaderboard data15.9%
33Qwen2-VL (72B) Instruct· Hugging Face Open LLM Leaderboard data15.9%
34Qwen 2.5 Coder 32B· Hugging Face Open LLM Leaderboard data15.9%
35Llama 3.3 70B Instruct· Hugging Face Open LLM Leaderboard data15.6%
36fimbulvetr-11b-v2· Hugging Face Open LLM Leaderboard data14.9%
37WizardLM 2 8x22B· Hugging Face Open LLM Leaderboard data14.5%
38Qwen 2 (7B)· Hugging Face Open LLM Leaderboard data14.3%
39gemma-2-9b· Hugging Face Open LLM Leaderboard data14.3%
40GLM 4 9B 0414· Hugging Face Open LLM Leaderboard data14.2%
41Qwen2 57B A14B Instruct· Hugging Face Open LLM Leaderboard data14.2%
42Magnum V2 72B· Hugging Face Open LLM Leaderboard data14.2%
43Qwen2.5 7B· Hugging Face Open LLM Leaderboard data14.1%
44Qwen1.5-14B-Chat· Hugging Face Open LLM Leaderboard data13.9%
45gemma2-27b· Hugging Face Open LLM Leaderboard data13.9%
46phi-2· Hugging Face Open LLM Leaderboard data13.8%
47Yi 1.5 34B Chat16k· Hugging Face Open LLM Leaderboard data13.7%
48Qwen 2.5 Coder 32B Instruct· Hugging Face Open LLM Leaderboard data13.7%
49Qwen2 VL 7b Instruct· Hugging Face Open LLM Leaderboard data13.6%
50Qwen2.5 32B Instruct· Hugging Face Open LLM Leaderboard data13.5%

Showing 1–50 of 161 results.

Data credits: Data by LLM Stats