Benchmark
RecreationBench paper · Android · Visual assertion score
Scores are percentages. Higher is better.
Benchmark sourceScores from BenchBoard docs.
- Models and systems measured
- 10
- Scores recorded
- 10
- Sources
- 1
- IQ weight
- 1.07
Score distribution
- 45.1%
- Mean
- 50.6%
- Median
- 14.9%
- Std dev
- 22.3%
- 10th percentile
- 57.8%
- 90th percentile
- 18.8%
- Min
This benchmark has a weight of 1.07 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model or system | Score |
|---|---|---|
| 1 | GPT-6 AstraRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 65% |
| 2 | GPT-5.6 SolRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 56.9% |
| 3 | Claude Opus 5RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 56.7% |
| 4 | Kimi K3RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 50.6% |
| 5 | Claude Opus 4.8RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 40.5% |
| 6 | Gemini 3.7 FlashRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · high reasoning effort per site data · 1m context · 64k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 34% |
| 7 | GLM 5.3RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 1m context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 22.3% |
| 8 | Qwen3.7 PlusRecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · thinking enabled per site data · 256k context · 32k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 18.8% |
Not ranked
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| Grok 4.6RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · xhigh reasoning effort per site data · 500k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs | 57.8% |
| Qwen3.8 Max 0902RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · xhigh reasoning effort per site data · 256k context · 32k max output tokens · Android · nominal 50-task split · platform-specific score· Reported by QwenLM / RecreationWorld authors· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 48.2% |