Skip to content

Benchmark

AndroidWorld agent system pass@4

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.

Models and systems measured
1
Scores recorded
1
Sources
1
IQ weight
No weight published

Score distribution

61.6%
Mean
61.6%
Median
0%
Std dev
61.6%
10th percentile
61.6%
90th percentile
61.6%
Min

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
OSCARGPT-4o, Screenshot, 1· AndroidWorld leaderboard data docs61.6%

Data credits: AndroidWorld leaderboard sheet, Google Research android_world. Community-submitted, self-reported results without independent verification; sheet licence not stated (code Apache-2.0 not applied).