Benchmark
AndroidWorld agent system
Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.
- Models and systems measured
- 14
- Scores recorded
- 14
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 71.6%
- Mean
- 75%
- Median
- 26.1%
- Std dev
- 34.5%
- 10th percentile
- 100%
- 90th percentile
- 30.6%
- Min
Results
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| agent-qa by Vostride AIgpt-6-sol, Screenshot + A11y tree, 1· AndroidWorld leaderboard data docs | 100% |
| AGI-0AGI-AW, Screenshot, 1· AndroidWorld leaderboard data docs | 100% |
| AndroidGenGPT-4o, A11y tree, 1· AndroidWorld leaderboard data docs | 46.8% |
| AndroidWorldGPT-4 Turbo, A11y tree, 1· AndroidWorld leaderboard data docs | 30.6% |
| GUI-ExplorerGPT-4o, Screenshot + A11y tree, 1· AndroidWorld leaderboard data docs | 47.4% |
| Midscene.jsGemini-3.5-Flash, Screenshot, 1· AndroidWorld leaderboard data docs | 93.1% |
| Mirage-1GPT-4o, Screenshot, 1· AndroidWorld leaderboard data docs | 42.2% |
| Mobile-Agent-v3GUI-Owl-32B, Screenshot, 1· AndroidWorld leaderboard data docs | 73.3% |
| MobileRunGPT6 Astra, Screenshot + A11y tree, 1· AndroidWorld leaderboard data docs | 100% |
| MobileUseQwen2.5-VL-72B, Screenshot, 1· AndroidWorld leaderboard data docs | 62.9% |
| MobileUse-v2Hammer-UI-32B, Screenshot, 1· AndroidWorld leaderboard data docs | 75% |
| MobileUseAgentSeed1.8-GUI, Screenshot, 1· AndroidWorld leaderboard data docs | 97.4% |
| Ponder & PressGPT-4o, Screenshot, 1· AndroidWorld leaderboard data docs | 34.5% |
| QalionClaude Haiku 5.5, Screenshot + A11y tree, 1· AndroidWorld leaderboard data docs | 99.1% |