Skip to content

Benchmark

Nejumi 4: ALT_制御性

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.41

Score distribution

0.825
Mean
0.855
Median
0.098
Std dev
0.67
10th percentile
0.923
90th percentile
0.517
Min
0.5170.947
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.41 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.749
102Qwen3 4BQwen/Qwen3-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.747
103Gemma 3 4B ITgoogle/gemma-3-4b-it· Nejumi Leaderboard 4 data docs0.744
104Claude 3.5 Sonnetanthropic/claude-3.5-sonnet-20241022· Nejumi Leaderboard 4 data docs0.742
105Llama 3.1 405B Instructmeta-llama/Llama-3.1-405B-Instruct-FP8· Nejumi Leaderboard 4 data docs0.737
106Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: no-thinking· Nejumi Leaderboard 4 data docs0.734
107Qwen3 1.7BQwen/Qwen3-1.7B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.732
108Ministral 3 14Bmistralai/Ministral-3-14B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.719
109Claude Haiku 3.5anthropic/claude-3.5-haiku-20241022· Nejumi Leaderboard 4 data docs0.713
110Claude Opus 4.5anthropic/claude-opus-4.5-20251125: no-thinking· Nejumi Leaderboard 4 data docs0.711
111Ministral 3 8Bmistralai/Ministral-3-8B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.705
112Claude Sonnet 4anthropic/claude-sonnet-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.705
113GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs0.67
114Qwen3 0.6BQwen/Qwen3-0.6B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.669
115Gemini 2.5 Flash-Litegoogle/gemini-2.5-flash-lite· Nejumi Leaderboard 4 data docs0.664
116Mistral Largemistral/mistral-large-2411· Nejumi Leaderboard 4 data docs0.664
117Ministral 3 3Bmistralai/Ministral-3-3B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.651
118MiniMax M2MiniMaxAI/MiniMax-M2: reasoning-enabled· Nejumi Leaderboard 4 data docs0.642
119ERNIE 4.5 21B A3Bbaidu/ERNIE-4.5-21B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.625
120Nova Pro 1.0us.amazon.nova-pro-v1:0· Nejumi Leaderboard 4 data docs0.617
121Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.602
122Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.596
123Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking: reasoning-enabled· Nejumi Leaderboard 4 data docs0.561
124QwQ 32BQwen/QwQ-32B· Nejumi Leaderboard 4 data docs0.531
125Llama 3.2 3Bmeta-llama/Llama-3.2-3B-Instruct· Nejumi Leaderboard 4 data docs0.529
126Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.517

Showing 101–126 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results