Skip to content

Benchmark

ExplorationBench · AlienLogic · M4 · hindsight-replay control

Scores are percentages. Higher is better.

Models and systems measured
10
Scores recorded
10
Sources
1
IQ weight
No weight published

Score distribution

73.4%
Mean
77.6%
Median
5.3%
Std dev
67.6%
10th percentile
78.1%
90th percentile
63.8%
Min
63.8%79.5%
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Claude Opus 5official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs77.6%
DeepSeek V4 Pro (version unspecified)official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs69%
DeepSeek V4.1 Flashofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs67.6%
Gemini 3.8 Flashofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs63.8%
GPT-5.6 Solofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs79.5%
Grok 4.6official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · xhigh reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs77.6%
Hy4 previewofficial 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.77.6%
Kimi K3official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs73.8%
Qwen3.8 Max 0902official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · max reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs78.1%
Seed2.1 Pro 0915official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory· Reported by Fudan University / Tencent Hy / Tsinghua University· via BenchBoard docs69%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.