Skip to content

Benchmark

Nejumi 4: GLP_知識・質問応答

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.50

Score distribution

0.618
Mean
0.646
Median
0.143
Std dev
0.423
10th percentile
0.787
90th percentile
0.199
Min
0.1990.815
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.50 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Qwen3.6 27BQwen/Qwen3.6-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.679
52Qwen3.5 27BQwen/Qwen3.5-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.677
53Qwen 3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.672
54Qwen3.6 35B A3BQwen/Qwen3.6-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.671
55Qwen3.5 35B A3BQwen/Qwen3.5-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.671
56MiniMax M2.1MiniMaxAI/MiniMax-M2.1: reasoning-enabled· Nejumi Leaderboard 4 data docs0.664
57o3 Miniopenai/o3-mini-2025-01-31· Nejumi Leaderboard 4 data docs0.663
58Claude Opus 4.1anthropic/claude-opus-4-1-20250805: extended-thinking· Nejumi Leaderboard 4 data docs0.656
59Kimi K2 Thinkingmoonshotai/kimi-k2-thinking· Nejumi Leaderboard 4 data docs0.652
60Grok 3 Minigrok-3-mini· Nejumi Leaderboard 4 data docs0.649
61Claude Sonnet 4anthropic/claude-sonnet-4-20250514: extended-thinking· Nejumi Leaderboard 4 data docs0.648
62Claude Opus 4.5anthropic/claude-opus-4.5-20251125: extended-thinking· Nejumi Leaderboard 4 data docs0.647
63Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-lite-preview· Nejumi Leaderboard 4 data docs0.646
64GPT-5 nanoopenai/gpt-5-nano-2025-08-07: high-effort· Nejumi Leaderboard 4 data docs0.641
65Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking: reasoning-enabled· Nejumi Leaderboard 4 data docs0.635
66Claude Sonnet 4.5anthropic/claude-sonnet-4-5-20250929: extended-thinking· Nejumi Leaderboard 4 data docs0.634
67Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.634
68Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001: extended-thinking· Nejumi Leaderboard 4 data docs0.633
69Claude Opus 4anthropic/claude-opus-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.631
70Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.621
71Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs0.619
72MiniMax M2MiniMaxAI/MiniMax-M2: reasoning-enabled· Nejumi Leaderboard 4 data docs0.618
73GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs0.613
74Qwen 3 235B A22BQwen/Qwen3-235B-A22B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.61
75Qwen3 VL 32B ThinkingQwen/Qwen3-VL-32B-Thinking· Nejumi Leaderboard 4 data docs0.604
76GPT 5.1openai/gpt-5.1-2025-11-13: none-effort· Nejumi Leaderboard 4 data docs0.603
77Qwen3 30B A3BQwen/Qwen3-30B-A3B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.596
78GPT 4.1openai/gpt-4-1-2025-04-14· Nejumi Leaderboard 4 data docs0.586
79GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.586
80Grok 3grok-3· Nejumi Leaderboard 4 data docs0.584
81Qwen3.5 4BQwen/Qwen3.5-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.584
82Qwen3 32BQwen/Qwen3-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.582
83QwQ 32BQwen/QwQ-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.577
84Gemini 2.5 Flashgoogle/gemini-2.5-flash· Nejumi Leaderboard 4 data docs0.577
85Qwen3 14BQwen/Qwen3-14B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.574
86Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs0.57
87GPT 4oopenai/gpt-4o-2024-11-20· Nejumi Leaderboard 4 data docs0.569
88Qwen: Qwen3 VL 8B ThinkingQwen/Qwen3-VL-8B-Thinking· Nejumi Leaderboard 4 data docs0.568
89Qwen3 30B A3BQwen/Qwen3-30B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.566
90GPT-4.1 miniopenai/gpt-4-1-mini-2025-04-14· Nejumi Leaderboard 4 data docs0.554
91Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-Instruct· Nejumi Leaderboard 4 data docs0.538
92DeepSeek V3deepseek-ai/DeepSeek-V3-0324· Nejumi Leaderboard 4 data docs0.538
93Gemma 4 E4B-itgoogle/gemma-4-E4B-it· Nejumi Leaderboard 4 data docs0.534
94Llama 3.1 405B Instructmeta-llama/Llama-3.1-405B-Instruct-FP8· Nejumi Leaderboard 4 data docs0.53
95Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507· Nejumi Leaderboard 4 data docs0.529
96Qwen3-4B-Thinking-2507Qwen/Qwen3-4B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.529
97Qwen3 8BQwen/Qwen3-8B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.528
98Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.521
99Gemma 4 E2B-itgoogle/gemma-4-E2B-it· Nejumi Leaderboard 4 data docs0.512
100Claude Opus 4.5anthropic/claude-opus-4.5-20251125: no-thinking· Nejumi Leaderboard 4 data docs0.511

Showing 51–100 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results