Benchmark
Nejumi 4: GLP_翻訳
Higher scores are better.
Benchmark sourceScores from Nejumi Leaderboard 4 data docs.
- Models measured
- 114
- Scores recorded
- 126
- Sources
- 1
- IQ weight
- 1.65
Score distribution
- 0.897
- Mean
- 0.907
- Median
- 0.055
- Std dev
- 0.89
- 10th percentile
- 0.914
- 90th percentile
- 0.335
- Min
This benchmark has a weight of 1.65 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 51 | Grok 3grok-3· Nejumi Leaderboard 4 data docs | 0.909 |
| 52 | Qwen3 Max PreviewQwen/Qwen3-Max-Preview· Nejumi Leaderboard 4 data docs | 0.909 |
| 53 | Gemma 4 26B A4Bgoogle/gemma-4-26B-A4B-it· Nejumi Leaderboard 4 data docs | 0.909 |
| 54 | GLM 4.7zai-org/GLM-4.7: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.908 |
| 55 | o4 Miniopenai/o4-mini-2025-04-16· Nejumi Leaderboard 4 data docs | 0.908 |
| 56 | DeepSeek V4 Prodeepseek-ai/DeepSeek-V4-Pro: reasoning-max· Nejumi Leaderboard 4 data docs | 0.907 |
| 57 | GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.907 |
| 58 | Claude Haiku 3.5anthropic/claude-3.5-haiku-20241022· Nejumi Leaderboard 4 data docs | 0.907 |
| 59 | Qwen3.5 122B-A10BQwen/Qwen3.5-122B-A10B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.907 |
| 60 | GPT-4.1 miniopenai/gpt-4-1-mini-2025-04-14· Nejumi Leaderboard 4 data docs | 0.907 |
| 61 | Grok 4.1 Fastx-ai/grok-4-1-fast-reasoning· Nejumi Leaderboard 4 data docs | 0.907 |
| 62 | DeepSeek V3.2deepseek-ai/DeepSeek-V3.2: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.907 |
| 63 | MiniMax M3MiniMaxAI/MiniMax-M3: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.907 |
| 64 | Claude Haiku 4.5anthropic/claude-haiku-4-5-20251001: extended-thinking· Nejumi Leaderboard 4 data docs | 0.907 |
| 65 | Qwen3.5 27BQwen/Qwen3.5-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.906 |
| 66 | DeepSeek R1deepseek-ai/DeepSeek-R1-0528: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.906 |
| 67 | Mistral Largemistral/mistral-large-2411· Nejumi Leaderboard 4 data docs | 0.906 |
| 68 | Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs | 0.906 |
| 69 | Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs | 0.905 |
| 70 | Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs | 0.905 |
| 71 | Llama 3.1 405B Instructmeta-llama/Llama-3.1-405B-Instruct-FP8· Nejumi Leaderboard 4 data docs | 0.905 |
| 72 | GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs | 0.905 |
| 73 | Qwen3.6 35B A3BQwen/Qwen3.6-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.905 |
| 74 | Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs | 0.904 |
| 75 | Qwen 3 235B A22B Thinking 2507Qwen/Qwen3-235B-A22B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.904 |
| 76 | Qwen3.5 35B A3BQwen/Qwen3.5-35B-A3B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.904 |
| 77 | Qwen3 Next 80B A3B InstructQwen/Qwen3-Next-80B-A3B-Instruct· Nejumi Leaderboard 4 data docs | 0.904 |
| 78 | o3 Miniopenai/o3-mini-2025-01-31· Nejumi Leaderboard 4 data docs | 0.904 |
| 79 | Mistral Smallmistral/mistral-small-2503· Nejumi Leaderboard 4 data docs | 0.904 |
| 80 | GLM 5.2z-ai/glm-5.2: openrouter-reasoning-xhigh· Nejumi Leaderboard 4 data docs | 0.903 |
| 81 | Qwen3.6 27BQwen/Qwen3.6-27B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.903 |
| 82 | GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.903 |
| 83 | GPT-5 nanoopenai/gpt-5-nano-2025-08-07: high-effort· Nejumi Leaderboard 4 data docs | 0.903 |
| 84 | Llama 4 Maverickmeta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8· Nejumi Leaderboard 4 data docs | 0.903 |
| 85 | Claude Sonnet 3.7anthropic/claude-3.7-sonnet-20250219: extended-thinking· Nejumi Leaderboard 4 data docs | 0.902 |
| 86 | Qwen3 30B A3BQwen/Qwen3-30B-A3B-Thinking-2507: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.902 |
| 87 | DeepSeek Reasonerdeepseek/DeepSeek-V3.2 (Thinking Mode)· Nejumi Leaderboard 4 data docs | 0.902 |
| 88 | Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs | 0.902 |
| 89 | Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs | 0.901 |
| 90 | QwQ 32BQwen/QwQ-32B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.901 |
| 91 | Qwen3.5 9BQwen/Qwen3.5-9B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.901 |
| 92 | Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs | 0.901 |
| 93 | Qwen 3 235B A22BQwen/Qwen3-235B-A22B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.901 |
| 94 | GPT-4.1 nanoopenai/gpt-4-1-nano-2025-04-14· Nejumi Leaderboard 4 data docs | 0.901 |
| 95 | Qwen3 VL 32B ThinkingQwen/Qwen3-VL-32B-Thinking· Nejumi Leaderboard 4 data docs | 0.901 |
| 96 | Gemma 4 E4B-itgoogle/gemma-4-E4B-it· Nejumi Leaderboard 4 data docs | 0.9 |
| 97 | Qwen3 14BQwen/Qwen3-14B: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.9 |
| 98 | GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs | 0.9 |
| 99 | Gemma 4 E2B-itgoogle/gemma-4-E2B-it· Nejumi Leaderboard 4 data docs | 0.898 |
| 100 | Qwen: Qwen3 VL 8B ThinkingQwen/Qwen3-VL-8B-Thinking· Nejumi Leaderboard 4 data docs | 0.898 |
Showing 51–100 of 126 results.
Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results