Skip to content

Benchmark

Humanity's Last Exam (no tools, text-only)

Scores are percentages.

Models measured
15
Scores recorded
15
Sources
1
IQ weight
3.04

Score distribution

41.7%
Mean
43.4%
Median
12.4%
Std dev
25.8%
10th percentile
56.9%
90th percentile
13.3%
Min
13.3%64.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 3.04 for chat models, measured over 15 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Claude Opus 5.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim64.4%
2Claude Sonnet 5.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim56.9%
3GPT-6.1 Sol· LLM Stats data52.9%
4Hy3 (Deep Infra)· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim47%
5ERNIE 5.5 Flash Preview· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim46.4%
6Claude Haiku 5.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim45.9%
7DeepSeek V4.1 Flash 1017· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim44%
8Hy4 preview· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim43.4%
9MiniMax M3.1 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim43.4%
10DeepSeek V4 Pro 0813· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim42.7%
11DeepSeek V4.1 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim39.1%
12Qwen3 Max· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim30.2%
13Inkling FP4· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim29.7%
14Solar Mini 4· LLM Stats data25.8%
15Seed 2.0 Mini· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim13.3%

Data credits: Data by LLM Stats