Skip to content
Models measured
158
Scores recorded
161
Sources
2
IQ weight
1.50

Score distribution

10.7%
Mean
10.2%
Median
7.7%
Std dev
3%
10th percentile
17.2%
90th percentile
0.456%
Min
0.456%76.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.50 for chat models, measured over 158 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Mixtral 8x22B Instruct v0.1· Hugging Face Open LLM Leaderboard data13.5%
52DeepSeek R1 Distill Llama 70B· Hugging Face Open LLM Leaderboard data13.3%
53Llama 3.1 Nemotron 70B Instruct HF· Hugging Face Open LLM Leaderboard data13.2%
54Yi 1.5 34B Chat· Hugging Face Open LLM Leaderboard data13.1%
55Phi-3 Medium 4K Instruct· Hugging Face Open LLM Leaderboard data13.1%
56Mixtral 8X7b V0.1· Hugging Face Open LLM Leaderboard data12.6%
57Gemma 7B IT· Hugging Face Open LLM Leaderboard data12.5%
58l3-70b-euryale-v2.1· Hugging Face Open LLM Leaderboard data12.2%
59DBRX-instruct· Hugging Face Open LLM Leaderboard data12.2%
60Qwen1.5-1.8B-Chat· Hugging Face Open LLM Leaderboard data12.2%
61OpenHermes 2.5 Mistral 7B· Hugging Face Open LLM Leaderboard data12.1%
62Qwen2 1.5b Instruct· Hugging Face Open LLM Leaderboard data12%
63OpenChat 3.5· Hugging Face Open LLM Leaderboard data11.7%
64Qwen2.5 72B Instruct· Hugging Face Open LLM Leaderboard data11.7%
65Nous-Hermes-llama-2-7b· Hugging Face Open LLM Leaderboard data11.7%
66Gemma 1.1 7B IT· Hugging Face Open LLM Leaderboard data11.5%
67gemma2-2b· Hugging Face Open LLM Leaderboard data11.4%
68vicuna-7b-v1.5· Hugging Face Open LLM Leaderboard data11.4%
69Phi-3 Medium 128K Instruct· Hugging Face Open LLM Leaderboard data11.4%
70MN 12b Mag Mell R1· Hugging Face Open LLM Leaderboard data11.3%
71NousResearch: Hermes 2 Pro - Llama-3 8B· Hugging Face Open LLM Leaderboard data11.2%
72Nous-Hermes-2-Mixtral-8x7B-SFT· Hugging Face Open LLM Leaderboard data11.1%
73Mixtral 8x7B Instruct v0.1· Hugging Face Open LLM Leaderboard data11.1%
74QwQ 32B· Hugging Face Open LLM Leaderboard data11%
75gemma-7b· Hugging Face Open LLM Leaderboard data11%
76Llama 3 70B Instruct· Hugging Face Open LLM Leaderboard data10.9%
77Mistral 7B v0.1· Hugging Face Open LLM Leaderboard data10.7%
78Qwen1.5-14B· Hugging Face Open LLM Leaderboard data10.5%
79C4AI Command R7b 12 2024· Hugging Face Open LLM Leaderboard data10.2%
80Qwen1.5-32B-Chat· Hugging Face Open LLM Leaderboard data10.2%
81Qwen 2.5 14B Instruct· Hugging Face Open LLM Leaderboard data10.2%
82QwQ 32B Preview· Hugging Face Open LLM Leaderboard data9.8%
83Gemma 2 9B IT· Hugging Face Open LLM Leaderboard data9.7%
84Yi-34B· Hugging Face Open LLM Leaderboard data9.6%
85Qwen2.5 Coder 7B Instruct· Hugging Face Open LLM Leaderboard data9.5%
86Yi-34B200k· Hugging Face Open LLM Leaderboard data9.4%
87Llama-2-7B-32K-Instruct· Hugging Face Open LLM Leaderboard data9.2%
88Qwen1.5-7B· Hugging Face Open LLM Leaderboard data9.2%
89Gemma 2 27B IT· Hugging Face Open LLM Leaderboard data9.1%
90Neural Daredevil 8B abliterated· Hugging Face Open LLM Leaderboard data9.1%
91Llama 3.1 8B· Hugging Face Open LLM Leaderboard data8.7%
92Llama 3.1 8B Instruct· Hugging Face Open LLM Leaderboard data8.6%
93Mistral Nemo· Hugging Face Open LLM Leaderboard data8.5%
94Qwen2.5 7B Instruct· Hugging Face Open LLM Leaderboard data8.5%
95Yi 34B Chat· Hugging Face Open LLM Leaderboard data8.4%
96mistral-7b-v0.3· Hugging Face Open LLM Leaderboard data8.4%
97granite-3-1-8b-base· Hugging Face Open LLM Leaderboard data8.4%
98Llama-2-13b-chat-hf· Hugging Face Open LLM Leaderboard data8.2%
99GLM-4-9b-chat· Hugging Face Open LLM Leaderboard data8.1%
100Llama 3 70b Instruct Abliterated v3.5· Hugging Face Open LLM Leaderboard data8%

Showing 51–100 of 161 results.

Data credits: Data by LLM Stats