Skip to content

Benchmark

Nejumi 4: GLP_論理的推論

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.50

Score distribution

0.825
Mean
0.855
Median
0.122
Std dev
0.68
10th percentile
0.935
90th percentile
0.25
Min
0.250.98
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.50 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507· Nejumi Leaderboard 4 data docs0.775
102Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.775
103GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.77
104Mistral Largemistral/mistral-large-2411· Nejumi Leaderboard 4 data docs0.76
105DeepSeek V3deepseek-ai/DeepSeek-V3-0324· Nejumi Leaderboard 4 data docs0.755
106Gemini 2.5 Flash-Litegoogle/gemini-2.5-flash-lite· Nejumi Leaderboard 4 data docs0.75
107Ministral 3 8Bmistralai/Ministral-3-8B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.745
108Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.735
109GPT 4oopenai/gpt-4o-2024-11-20· Nejumi Leaderboard 4 data docs0.72
110Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs0.72
111Claude Haiku 3.5anthropic/claude-3.5-haiku-20241022· Nejumi Leaderboard 4 data docs0.715
112Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.68
113Ministral 3 14Bmistralai/Ministral-3-14B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.68
114Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.68
115GPT-4.1 nanoopenai/gpt-4-1-nano-2025-04-14· Nejumi Leaderboard 4 data docs0.675
116Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.665
117ERNIE 4.5 21B A3Bbaidu/ERNIE-4.5-21B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.66
118Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.66
119GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs0.63
120Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs0.61
121Qwen3 1.7BQwen/Qwen3-1.7B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.6
122Ministral 3 3Bmistralai/Ministral-3-3B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.475
123Gemma 3 4B ITgoogle/gemma-3-4b-it· Nejumi Leaderboard 4 data docs0.45
124Mistral Smallmistral/mistral-small-2503· Nejumi Leaderboard 4 data docs0.39
125Llama 3.2 3Bmeta-llama/Llama-3.2-3B-Instruct· Nejumi Leaderboard 4 data docs0.325
126Qwen3 0.6BQwen/Qwen3-0.6B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.25

Showing 101–126 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results