Skip to content

Benchmark

Nejumi 4: TOTAL_SCORE

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.76

Score distribution

0.73
Mean
0.743
Median
0.097
Std dev
0.589
10th percentile
0.831
90th percentile
0.404
Min
0.4040.872
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.76 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Gemma 4 E2B-itgoogle/gemma-4-E2B-it· Nejumi Leaderboard 4 data docs0.656
102Llama 3.1 405B Instructmeta-llama/Llama-3.1-405B-Instruct-FP8· Nejumi Leaderboard 4 data docs0.651
103Llama 4 Maverickmeta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8· Nejumi Leaderboard 4 data docs0.646
104Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs0.635
105Claude Haiku 3.5anthropic/claude-3.5-haiku-20241022· Nejumi Leaderboard 4 data docs0.63
106Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.628
107Mistral Largemistral/mistral-large-2411· Nejumi Leaderboard 4 data docs0.62
108GPT-4.1 nanoopenai/gpt-4-1-nano-2025-04-14· Nejumi Leaderboard 4 data docs0.616
109GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs0.615
110Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.61
111Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.608
112Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs0.599
113Nova Pro 1.0us.amazon.nova-pro-v1:0· Nejumi Leaderboard 4 data docs0.589
114Mistral Smallmistral/mistral-small-2503· Nejumi Leaderboard 4 data docs0.578
115Ministral 3 14Bmistralai/Ministral-3-14B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.561
116Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.554
117Qwen3 1.7BQwen/Qwen3-1.7B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.553
118Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.548
119Gemini 2.5 Flash-Litegoogle/gemini-2.5-flash-lite· Nejumi Leaderboard 4 data docs0.548
120ERNIE 4.5 21B A3Bbaidu/ERNIE-4.5-21B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.547
121Ministral 3 8Bmistralai/Ministral-3-8B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.544
122Gemma 3 4B ITgoogle/gemma-3-4b-it· Nejumi Leaderboard 4 data docs0.533
123QwQ 32BQwen/QwQ-32B· Nejumi Leaderboard 4 data docs0.531
124Ministral 3 3Bmistralai/Ministral-3-3B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.457
125Qwen3 0.6BQwen/Qwen3-0.6B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.409
126Llama 3.2 3Bmeta-llama/Llama-3.2-3B-Instruct· Nejumi Leaderboard 4 data docs0.404

Showing 101–126 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results