Skip to content

Benchmark

Nejumi 4: GLP_翻訳

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.65

Score distribution

0.897
Mean
0.907
Median
0.055
Std dev
0.89
10th percentile
0.914
90th percentile
0.335
Min
0.3350.916
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.65 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Grok 3grok-3· Nejumi Leaderboard 4 data docs0.909
52Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs0.909
53Gemma 4 26B A4Bgoogle/gemma-4-26B-A4B-it· Nejumi Leaderboard 4 data docs0.909
54GLM 4.7zai-org/GLM-4.7: reasoning-enabled· Nejumi Leaderboard 4 data docs0.908
55o4 Miniopenai/o4-mini-2025-04-16· Nejumi Leaderboard 4 data docs0.908
56DeepSeek V4 Prodeepseek-ai/DeepSeek-V4-Pro: reasoning-max· Nejumi Leaderboard 4 data docs0.907
57GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs0.907
58Claude Haiku 3.5anthropic/claude-3.5-haiku-20241022· Nejumi Leaderboard 4 data docs0.907
59Qwen3.5 122B-A10BQwen/Qwen3.5-122B-A10B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.907
60GPT-4.1 miniopenai/gpt-4-1-mini-2025-04-14· Nejumi Leaderboard 4 data docs0.907
61Grok 4.1 Fastx-ai/grok-4-1-fast-reasoning· Nejumi Leaderboard 4 data docs0.907
62DeepSeek V3.2deepseek-ai/DeepSeek-V3.2: reasoning-enabled· Nejumi Leaderboard 4 data docs0.907
63MiniMax M3MiniMaxAI/MiniMax-M3: reasoning-enabled· Nejumi Leaderboard 4 data docs0.907
64Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001: extended-thinking· Nejumi Leaderboard 4 data docs0.907
65Qwen3.5 27BQwen/Qwen3.5-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.906
66DeepSeek R1deepseek-ai/DeepSeek-R1-0528: reasoning-enabled· Nejumi Leaderboard 4 data docs0.906
67Mistral Largemistral/mistral-large-2411· Nejumi Leaderboard 4 data docs0.906
68Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.906
69Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.905
70Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs0.905
71Llama 3.1 405B Instructmeta-llama/Llama-3.1-405B-Instruct-FP8· Nejumi Leaderboard 4 data docs0.905
72GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs0.905
73Qwen3.6 35B A3BQwen/Qwen3.6-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.905
74Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.904
75Qwen 3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.904
76Qwen3.5 35B A3BQwen/Qwen3.5-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.904
77Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-Instruct· Nejumi Leaderboard 4 data docs0.904
78o3 Miniopenai/o3-mini-2025-01-31· Nejumi Leaderboard 4 data docs0.904
79Mistral Smallmistral/mistral-small-2503· Nejumi Leaderboard 4 data docs0.904
80GLM 5.2z-ai/glm-5.2: openrouter-reasoning-xhigh· Nejumi Leaderboard 4 data docs0.903
81Qwen3.6 27BQwen/Qwen3.6-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.903
82GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs0.903
83GPT-5 nanoopenai/gpt-5-nano-2025-08-07: high-effort· Nejumi Leaderboard 4 data docs0.903
84Llama 4 Maverickmeta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8· Nejumi Leaderboard 4 data docs0.903
85Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: extended-thinking· Nejumi Leaderboard 4 data docs0.902
86Qwen3 30B A3BQwen/Qwen3-30B-A3B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs0.902
87DeepSeek Reasonerdeepseek/DeepSeek-V3.2 (Thinking Mode)· Nejumi Leaderboard 4 data docs0.902
88Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.902
89Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.901
90QwQ 32BQwen/QwQ-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.901
91Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.901
92Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs0.901
93Qwen 3 235B A22BQwen/Qwen3-235B-A22B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.901
94GPT-4.1 nanoopenai/gpt-4-1-nano-2025-04-14· Nejumi Leaderboard 4 data docs0.901
95Qwen3 VL 32B ThinkingQwen/Qwen3-VL-32B-Thinking· Nejumi Leaderboard 4 data docs0.901
96Gemma 4 E4B-itgoogle/gemma-4-E4B-it· Nejumi Leaderboard 4 data docs0.9
97Qwen3 14BQwen/Qwen3-14B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.9
98GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.9
99Gemma 4 E2B-itgoogle/gemma-4-E2B-it· Nejumi Leaderboard 4 data docs0.898
100Qwen: Qwen3 VL 8B ThinkingQwen/Qwen3-VL-8B-Thinking· Nejumi Leaderboard 4 data docs0.898

Showing 51–100 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results