Benchmark
RecreationBench paper · Windows · Programmatic assertion score
Scores are percentages. Higher is better.
Benchmark sourceScores from BenchBoard docs.
- Models and systems measured
- 10
- Scores recorded
- 10
- Sources
- 1
- IQ weight
- 0.80
Score distribution
- 33.7%
- Mean
- 35.1%
- Median
- 15.5%
- Std dev
- 13.3%
- 10th percentile
- 50.3%
- 90th percentile
- 9.1%
- Min
This benchmark has a weight of 0.80 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model or system | Score |
|---|---|---|
| 1 | GPT-6 AstraRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 61.4% |
| 2 | Claude Opus 5RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 50.3% |
| 3 | GPT-5.6 SolRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 47.9% |
| 4 | Claude Opus 4.8RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 35.1% |
| 5 | Kimi K3RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 29.3% |
| 6 | GLM 5.3RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 23.2% |
| 7 | Gemini 3.7 FlashRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · high reasoning effort per site data · 1m context · 64k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 13.3% |
| 8 | Qwen3.7 PlusRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · thinking enabled per site data · 256k context · 32k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 9.1% |
Not ranked
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| Grok 4.6RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · xhigh reasoning effort per site data · 500k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 36.1% |
| Qwen3.8 Max 0902RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · xhigh reasoning effort per site data · 256k context · 32k max output tokens · Windows · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 31.5% |