Skip to content

Benchmark

Nejumi 4: GLP_構文解析

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.70

Score distribution

0.745
Mean
0.802
Median
0.17
Std dev
0.583
10th percentile
0.875
90th percentile
0
Min
00.9
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.70 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Grok 4grok-4· Nejumi Leaderboard 4 data docs0.823
52Grok 4.20xai/grok-4.20-0309-reasoning· Nejumi Leaderboard 4 data docs0.823
53Qwen3.5 27BQwen/Qwen3.5-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.823
54GLM 5.2zai-org/GLM-5.2: reasoning-max· Nejumi Leaderboard 4 data docs0.822
55GPT 4oopenai/gpt-4o-2024-11-20· Nejumi Leaderboard 4 data docs0.818
56GLM 5.2z-ai/glm-5.2: openrouter-reasoning-xhigh· Nejumi Leaderboard 4 data docs0.815
57Claude Sonnet 4anthropic/claude-sonnet-4-20250514: extended-thinking· Nejumi Leaderboard 4 data docs0.813
58o4 Miniopenai/o4-mini-2025-04-16· Nejumi Leaderboard 4 data docs0.813
59Qwen3.6 27BQwen/Qwen3.6-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.813
60Qwen3.5 35B A3BQwen/Qwen3.5-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.805
61GPT 5.1openai/gpt-5.1-2025-11-13: none-effort· Nejumi Leaderboard 4 data docs0.803
62MiniMax M2.1MiniMaxAI/MiniMax-M2.1: reasoning-enabled· Nejumi Leaderboard 4 data docs0.803
63Claude Opus 4.1anthropic/claude-opus-4-1-20250805: extended-thinking· Nejumi Leaderboard 4 data docs0.802
64Gemini 2.5 Flashgoogle/gemini-2.5-flash· Nejumi Leaderboard 4 data docs0.8
65Claude Opus 4anthropic/claude-opus-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.8
66Grok 3grok-3· Nejumi Leaderboard 4 data docs0.798
67GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs0.792
68Qwen3.6 35B A3BQwen/Qwen3.6-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.792
69DeepSeek V3deepseek-ai/DeepSeek-V3-0324· Nejumi Leaderboard 4 data docs0.788
70Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.788
71Qwen3 32BQwen/Qwen3-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.782
72GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.782
73DeepSeek V4 Prodeepseek-ai/DeepSeek-V4-Pro: reasoning-max· Nejumi Leaderboard 4 data docs0.773
74QwQ 32BQwen/QwQ-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.773
75Kimi K2 Thinkingmoonshotai/kimi-k2-thinking· Nejumi Leaderboard 4 data docs0.768
76Kimi K2.5moonshotai/Kimi-K2.5: reasoning-enabled· Nejumi Leaderboard 4 data docs0.768
77Qwen3 14BQwen/Qwen3-14B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.768
78Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-Instruct· Nejumi Leaderboard 4 data docs0.768
79Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001: extended-thinking· Nejumi Leaderboard 4 data docs0.767
80MiniMax M2MiniMaxAI/MiniMax-M2: reasoning-enabled· Nejumi Leaderboard 4 data docs0.765
81Qwen 3 235B A22BQwen/Qwen3-235B-A22B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.765
82Qwen3 30B A3BQwen/Qwen3-30B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.762
83Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs0.758
84Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.755
85GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs0.753
86DeepSeek V4 Prodeepseek/deepseek-v4-pro: thinking-max· Nejumi Leaderboard 4 data docs0.752
87Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.75
88Qwen 3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.747
89Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking: reasoning-enabled· Nejumi Leaderboard 4 data docs0.73
90Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.725
91Gemma 4 E4B-itgoogle/gemma-4-E4B-it· Nejumi Leaderboard 4 data docs0.72
92Qwen3 8BQwen/Qwen3-8B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.72
93Qwen3 VL 32B ThinkingQwen/Qwen3-VL-32B-Thinking· Nejumi Leaderboard 4 data docs0.718
94GPT-4.1 miniopenai/gpt-4-1-mini-2025-04-14· Nejumi Leaderboard 4 data docs0.715
95GPT-4.1 nanoopenai/gpt-4-1-nano-2025-04-14· Nejumi Leaderboard 4 data docs0.715
96Qwen3 4BQwen/Qwen3-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.715
97Qwen3.5 4BQwen/Qwen3.5-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.71
98Gemma 4 E2B-itgoogle/gemma-4-E2B-it· Nejumi Leaderboard 4 data docs0.708
99Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.702
100Qwen3 30B A3BQwen/Qwen3-30B-A3B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.702

Showing 51–100 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results