Benchmark
Orak StarCraftII Elo
Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are Elo ratings. Higher ratings are better.
- Models measured
- 4
- Scores recorded
- 4
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 1,518.8
- Mean
- 1,525
- Median
- 20.8
- Std dev
- 1,500
- 10th percentile
- 1,550.1
- 90th percentile
- 1,500
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 3.7zero-shot· Orak leaderboard docs | 1,550.1 |
| 2 | GPT 4ozero-shot· Orak leaderboard docs | 1,525 |
| 3 | GPT-4o minizero-shot· Orak leaderboard docs | 1,500 |
| 4 | o3 Minizero-shot· Orak leaderboard docs | 1,500 |