Skip to content

Benchmark

Nejumi 4: GLP_コーディング

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.44

Score distribution

0.555
Mean
0.579
Median
0.106
Std dev
0.431
10th percentile
0.667
90th percentile
0.135
Min
0.1350.908
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.44 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.477
102Qwen3 32BQwen/Qwen3-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.476
103Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.465
104Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.457
105Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.452
106GPT-5 nanoopenai/gpt-5-nano-2025-08-07: high-effort· Nejumi Leaderboard 4 data docs0.45
107Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507· Nejumi Leaderboard 4 data docs0.449
108Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.449
109Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.445
110Qwen3 8BQwen/Qwen3-8B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.44
111Ministral 3 14Bmistralai/Ministral-3-14B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.438
112Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.431
113Gemini 2.5 Flash-Litegoogle/gemini-2.5-flash-lite· Nejumi Leaderboard 4 data docs0.431
114Qwen3.5 4BQwen/Qwen3.5-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.43
115ERNIE 4.5 21B A3Bbaidu/ERNIE-4.5-21B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.425
116Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs0.418
117Ministral 3 8Bmistralai/Ministral-3-8B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.417
118Qwen3 30B A3BQwen/Qwen3-30B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.415
119Qwen3 4BQwen/Qwen3-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.413
120Kimi K2 Thinkingmoonshotai/kimi-k2-thinking· Nejumi Leaderboard 4 data docs0.391
121Gemma 3 4B ITgoogle/gemma-3-4b-it· Nejumi Leaderboard 4 data docs0.39
122Ministral 3 3Bmistralai/Ministral-3-3B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.368
123Qwen3 1.7BQwen/Qwen3-1.7B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.313
124Mistral Smallmistral/mistral-small-2503· Nejumi Leaderboard 4 data docs0.293
125Qwen3 0.6BQwen/Qwen3-0.6B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.189
126Llama 3.2 3Bmeta-llama/Llama-3.2-3B-Instruct· Nejumi Leaderboard 4 data docs0.135

Showing 101–126 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results