Skip to content

Benchmark

Nejumi 4: ALT_真実性

Higher scores are better.

Models measured
114
Scores recorded
126
Sources
1
IQ weight
1.11

Score distribution

0.655
Mean
0.703
Median
0.186
Std dev
0.353
10th percentile
0.849
90th percentile
0.125
Min
0.1250.885
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.11 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Gemini 3.1 Flash Litegoogle/gemini-3.1-flash-lite-preview· Nejumi Leaderboard 4 data docs0.486
102Grok 4.20xai/grok-4.20-0309-reasoning· Nejumi Leaderboard 4 data docs0.485
103DeepSeek V3deepseek-ai/DeepSeek-V3-0324· Nejumi Leaderboard 4 data docs0.484
104DeepSeek V4 Flashdeepseek-ai/DeepSeek-V4-Flash: reasoning-max· Nejumi Leaderboard 4 data docs0.476
105GLM 4.7 Flashzai-org/GLM-4.7-Flash: reasoning-enabled· Nejumi Leaderboard 4 data docs0.474
106Llama 4 Scoutmeta-llama/Llama-4-Scout-17B-16E-Instruct· Nejumi Leaderboard 4 data docs0.472
107Gemini 2.5 Flash-Litegoogle/gemini-2.5-flash-lite· Nejumi Leaderboard 4 data docs0.452
108Qwen3 4BQwen/Qwen3-4B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.443
109GLM 4.6zai-org/GLM-4.6-FP8: reasoning-enabled· Nejumi Leaderboard 4 data docs0.441
110GPT OSS 120Bopenai/gpt-oss-120b: reasoning-enabled· Nejumi Leaderboard 4 data docs0.396
111Nova Pro 1.0us.amazon.nova-pro-v1:0· Nejumi Leaderboard 4 data docs0.39
112Mistral Large 3 675b Instructmistralai/Mistral-Large-3-675B-Instruct-2512· Nejumi Leaderboard 4 data docs0.387
113Llama 3.3 70B Instructmeta-llama/Llama-3.3-70B-Instruct· Nejumi Leaderboard 4 data docs0.353
114Nova Lite 1.0us.amazon.nova-lite-v1:0· Nejumi Leaderboard 4 data docs0.337
115GPT-4o miniopenai/gpt-4o-mini-2024-07-18· Nejumi Leaderboard 4 data docs0.321
116Gemma 3 27B ITgoogle/gemma-3-27b-it· Nejumi Leaderboard 4 data docs0.308
117Gemma 3 12B ITgoogle/gemma-3-12b-it· Nejumi Leaderboard 4 data docs0.298
118Qwen3 1.7BQwen/Qwen3-1.7B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.297
119Nova Micro 1.0us.amazon.nova-micro-v1:0· Nejumi Leaderboard 4 data docs0.296
120Ministral 3 14Bmistralai/Ministral-3-14B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.248
121Gemma 3 4B ITgoogle/gemma-3-4b-it· Nejumi Leaderboard 4 data docs0.247
122Ministral 3 3Bmistralai/Ministral-3-3B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.241
123ERNIE 4.5 21B A3Bbaidu/ERNIE-4.5-21B-A3B-Thinking· Nejumi Leaderboard 4 data docs0.238
124Ministral 3 8Bmistralai/Ministral-3-8B-Reasoning-2512· Nejumi Leaderboard 4 data docs0.206
125Llama 3.2 3Bmeta-llama/Llama-3.2-3B-Instruct· Nejumi Leaderboard 4 data docs0.192
126Qwen3 0.6BQwen/Qwen3-0.6B: reasoning-enabled· Nejumi Leaderboard 4 data docs0.125

Showing 101–126 of 126 results.

Data credits: Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results