Skip to content

Benchmark

Nejumi 4: GLP_関数呼び出し

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.19

Score distribution

0.602
Mean
0.62
Median
0.087
Std dev
0.501
10th percentile
0.694
90th percentile
0.204
Min
0.2040.725
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.19 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT-5.6 Solopenai/gpt-5.6-sol: max-effort· Nejumi Leaderboard 4 data docs0.725
2Claude Opus 4.7anthropic/claude-opus-4.7: adaptive-thinking-xhigh· Nejumi Leaderboard 4 data docs0.722
3Claude Opus 4.8anthropic/claude-opus-4.8: adaptive-thinking-xhigh· Nejumi Leaderboard 4 data docs0.719
4GLM 5zai-org/GLM-5: reasoning-enabled· Nejumi Leaderboard 4 data docs0.717
5Claude Opus 4.1anthropic/claude-opus-4-1-20250805: extended-thinking· Nejumi Leaderboard 4 data docs0.714
6Claude Opus 4.5anthropic/claude-opus-4.5-20251125: extended-thinking· Nejumi Leaderboard 4 data docs0.713
7Claude Opus 4.5anthropic/claude-opus-4.5-20251125: no-thinking· Nejumi Leaderboard 4 data docs0.706
8Claude Opus 4anthropic/claude-opus-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.701
9Claude Opus 5anthropic/claude-opus-5: adaptive-thinking-max· Nejumi Leaderboard 4 data docs0.699
10Claude Opus 4.6anthropic/claude-opus-4-6: extended-thinking· Nejumi Leaderboard 4 data docs0.698
11Claude Fable 5anthropic/claude-fable-5: adaptive-thinking-max with fallback to Opus 4.8· Nejumi Leaderboard 4 data docs0.697
12Qwen3.6 27BQwen/Qwen3.6-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.695
13GLM 4.7zai-org/GLM-4.7: reasoning-enabled· Nejumi Leaderboard 4 data docs0.694
14Qwen3.6 Max Previewqwen/qwen3.6-max-preview: openrouter-reasoning· Nejumi Leaderboard 4 data docs0.694
15Claude Sonnet 4anthropic/claude-sonnet-4-20250514: extended-thinking· Nejumi Leaderboard 4 data docs0.69
16Gemini 3 Pro Previewgoogle/gemini-3-pro-preview· Nejumi Leaderboard 4 data docs0.688
17Claude Sonnet 4anthropic/claude-sonnet-4-20250514: no-thinking· Nejumi Leaderboard 4 data docs0.687
18GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs0.687
19Gemini 3.1 Pro Previewgoogle/gemini-3.1-pro-preview· Nejumi Leaderboard 4 data docs0.686
20GLM 5.2z-ai/glm-5.2: openrouter-reasoning-xhigh· Nejumi Leaderboard 4 data docs0.685
21Claude Sonnet 4.6anthropic/claude-sonnet-4.6: extended-thinking· Nejumi Leaderboard 4 data docs0.685
22Claude 3.5 Sonnetanthropic/claude-3.5-sonnet-20241022· Nejumi Leaderboard 4 data docs0.679
23GPT-5.6 Lunaopenai/gpt-5.6-luna: max-effort· Nejumi Leaderboard 4 data docs0.679
24Gemma 4 31B ITgoogle/gemma-4-31b-it· Nejumi Leaderboard 4 data docs0.678
25Qwen3.5 122B-A10BQwen/Qwen3.5-122B-A10B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.675
26Kimi K3moonshotai/kimi-k3: reasoning-max· Nejumi Leaderboard 4 data docs0.675
27Qwen3.5 397B A17BQwen/Qwen3.5-397B-A17B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.675
28GPT 5.4openai/gpt-5.4-2026-03-05: high-effort· Nejumi Leaderboard 4 data docs0.673
29GLM 5.2zai-org/GLM-5.2: reasoning-max· Nejumi Leaderboard 4 data docs0.669
30Grok 3grok-3· Nejumi Leaderboard 4 data docs0.669
31Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.668
32Claude Sonnet 4.5anthropic/claude-sonnet-4-5-20250929: extended-thinking· Nejumi Leaderboard 4 data docs0.668
33MiniMax M3MiniMaxAI/MiniMax-M3: reasoning-enabled· Nejumi Leaderboard 4 data docs0.667
34GPT 5.5openai/gpt-5.5-2026-04-23: xhigh-effort· Nejumi Leaderboard 4 data docs0.666
35GPT-5.6 Terraopenai/gpt-5.6-terra: max-effort· Nejumi Leaderboard 4 data docs0.666
36GPT 5.5openai/gpt-5.5-2026-04-23: high-effort· Nejumi Leaderboard 4 data docs0.665
37Gemini 3.6 Flashgoogle/gemini-3.6-flash· Nejumi Leaderboard 4 data docs0.659
38Qwen3 Next 80B A3BQwen/Qwen3-Next-80B-A3B-Thinking: reasoning-enabled· Nejumi Leaderboard 4 data docs0.657
39Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: extended-thinking· Nejumi Leaderboard 4 data docs0.653
40Qwen3.6 35B A3BQwen/Qwen3.6-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.652
41GPT 4oopenai/gpt-4o-2024-11-20· Nejumi Leaderboard 4 data docs0.652
42Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-lite-preview· Nejumi Leaderboard 4 data docs0.651
43Grok 4.1 Fastx-ai/grok-4-1-fast-reasoning· Nejumi Leaderboard 4 data docs0.649
44Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs0.648
45Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001: extended-thinking· Nejumi Leaderboard 4 data docs0.646
46Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: no-thinking· Nejumi Leaderboard 4 data docs0.646
47OpenAI o3openai/o3-2025-04-16: high-effort· Nejumi Leaderboard 4 data docs0.644
48Qwen3.5 27BQwen/Qwen3.5-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.643
49Kimi K2.5moonshotai/Kimi-K2.5: reasoning-enabled· Nejumi Leaderboard 4 data docs0.641
50Qwen 3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.639

Showing 1–50 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results