Skip to content

Benchmark

CyberGym Level 1 success rate (any of 30 trials)

Higher scores are better.

Models measured
4
Scores recorded
4
Sources
1
IQ weight
No weight published

Score distribution

0.587
Mean
0.613
Median
0.071
Std dev
0.472
10th percentile
0.667
90th percentile
0.472
Min
0.4720.667
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Claude Sonnet 4.5agent: Anthropic Agent, trials: 30, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs0.667
2Claude Opus 4.1agent: Anthropic Agent, trials: 30, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs0.613
3Claude Sonnet 4agent: Anthropic Agent, trials: 30, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs0.595
4Claude Sonnet 3.7agent: Anthropic Agent, trials: 30, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs0.472

Data credits: CyberGym leaderboard (Wang, Shi, He, Cai, Zhang, Song; UC Berkeley), ICLR 2026. Results evaluated and submitted by the listed teams. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only.