Skip to content

Benchmark

ExplorationBench · AlienLogic · M4 · without-tool control

Scores are percentages. Higher is better.

Models and systems measured
10
Scores recorded
10
Sources
1
IQ weight
No weight published

Score distribution

44.3%
Mean
48.1%
Median
9.1%
Std dev
33.3%
10th percentile
56.7%
90th percentile
29.5%
Min
29.5%57.1%
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Claude Opus 5official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs57.1%
DeepSeek V4 Pro (version unspecified)official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs29.5%
DeepSeek V4.1 Flashofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs41%
Gemini 3.8 Flashofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs50.5%
GPT-5.6 Solofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs50%
Grok 4.6official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · xhigh reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs48.1%
Hy4 previewofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.39%
Kimi K3official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs33.3%
Qwen3.8 Max 0902official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs56.7%
Seed2.1 Pro 0915official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs37.6%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.