Skip to content

Benchmark

Nejumi 4: TOTAL_SCORE

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.76

Score distribution

0.73
Mean
0.743
Median
0.097
Std dev
0.589
10th percentile
0.831
90th percentile
0.404
Min
0.4040.872
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.76 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51GPT-5.4 miniopenai/gpt-5.4-mini-2026-03-17: high-effort· Nejumi Leaderboard 4 data docs0.778
52GLM 4.7zai-org/GLM-4.7: reasoning-enabled· Nejumi Leaderboard 4 data docs0.777
53o1openai/o1-2024-12-17: high-effort· Nejumi Leaderboard 4 data docs0.775
54DeepSeek V4 Flashdeepseek-ai/DeepSeek-V4-Flash: reasoning-max· Nejumi Leaderboard 4 data docs0.774
55Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: extended-thinking· Nejumi Leaderboard 4 data docs0.773
56Grok 4.20xai/grok-4.20-0309-reasoning· Nejumi Leaderboard 4 data docs0.773
57Gemini 2.5 Progoogle/gemini-2.5-pro· Nejumi Leaderboard 4 data docs0.77
58Grok 4.1 Fastx-ai/grok-4-1-fast-reasoning· Nejumi Leaderboard 4 data docs0.765
59o4 Miniopenai/o4-mini-2025-04-16· Nejumi Leaderboard 4 data docs0.761
60Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.756
61MiniMax M2.1MiniMaxAI/MiniMax-M2.1: reasoning-enabled· Nejumi Leaderboard 4 data docs0.756
62Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.748
63DeepSeek R1deepseek-ai/DeepSeek-R1-0528: reasoning-enabled· Nejumi Leaderboard 4 data docs0.743
64o3 Miniopenai/o3-mini-2025-01-31· Nejumi Leaderboard 4 data docs0.743
65Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs0.742
66GPT 5.1openai/gpt-5.1-2025-11-13: none-effort· Nejumi Leaderboard 4 data docs0.741
67Qwen3 VL 32B ThinkingQwen/Qwen3-VL-32B-Thinking· Nejumi Leaderboard 4 data docs0.741
68Grok 3 Minigrok-3-mini· Nejumi Leaderboard 4 data docs0.737
69Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking: reasoning-enabled· Nejumi Leaderboard 4 data docs0.736
70Qwen3.5 4BQwen/Qwen3.5-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.735
71GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs0.734
72Kimi K2 Thinkingmoonshotai/kimi-k2-thinking· Nejumi Leaderboard 4 data docs0.733
73Qwen3 30B A3BQwen/Qwen3-30B-A3B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.733
74Claude Opus 4.5anthropic/claude-opus-4.5-20251125: no-thinking· Nejumi Leaderboard 4 data docs0.732
75Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-lite-preview· Nejumi Leaderboard 4 data docs0.728
76GPT 4.1openai/gpt-4-1-2025-04-14· Nejumi Leaderboard 4 data docs0.726
77Grok 3grok-3· Nejumi Leaderboard 4 data docs0.725
78Qwen3 14BQwen/Qwen3-14B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.723
79GPT 4oopenai/gpt-4o-2024-11-20· Nejumi Leaderboard 4 data docs0.722
80Qwen 3 235B A22BQwen/Qwen3-235B-A22B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.721
81Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: no-thinking· Nejumi Leaderboard 4 data docs0.718
82GPT-5 nanoopenai/gpt-5-nano-2025-08-07: high-effort· Nejumi Leaderboard 4 data docs0.717
83Claude Sonnet 4anthropic/claude-sonnet-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.715
84Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-Instruct· Nejumi Leaderboard 4 data docs0.713
85MiniMax M2MiniMaxAI/MiniMax-M2: reasoning-enabled· Nejumi Leaderboard 4 data docs0.713
86Qwen3 32BQwen/Qwen3-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.709
87Claude 3.5 Sonnetanthropic/claude-3.5-sonnet-20241022· Nejumi Leaderboard 4 data docs0.706
88Qwen3 30B A3BQwen/Qwen3-30B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.703
89QwQ 32BQwen/QwQ-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.703
90Qwen: Qwen3 VL 8B ThinkingQwen/Qwen3-VL-8B-Thinking· Nejumi Leaderboard 4 data docs0.702
91GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs0.701
92GPT-4.1 miniopenai/gpt-4-1-mini-2025-04-14· Nejumi Leaderboard 4 data docs0.699
93Gemini 2.5 Flashgoogle/gemini-2.5-flash· Nejumi Leaderboard 4 data docs0.697
94Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507· Nejumi Leaderboard 4 data docs0.696
95Qwen3 8BQwen/Qwen3-8B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.69
96GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.685
97DeepSeek V3deepseek-ai/DeepSeek-V3-0324· Nejumi Leaderboard 4 data docs0.676
98Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.672
99Gemma 4 E4B-itgoogle/gemma-4-E4B-it· Nejumi Leaderboard 4 data docs0.669
100Qwen3 4BQwen/Qwen3-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.661

Showing 51–100 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results