Benchmark
CyberGym Level 1 success rate
Higher scores are better.
Benchmark sourceScores from CyberGym leaderboard data docs.
- Models measured
- 31
- Scores recorded
- 37
- Sources
- 1
- IQ weight
- 1.53
Score distribution
- 0.444
- Mean
- 0.432
- Median
- 0.296
- Std dev
- 0.072
- 10th percentile
- 0.818
- 90th percentile
- 0.0186
- Min
This benchmark has a weight of 1.53 for chat models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3.8 Flash Cyberagent: Google Antigravity, trials: 1, reported by: Google, date: 2026-09-10· CyberGym leaderboard data docs | 0.863 |
| 2 | GPT-5.5-cyberagent: OpenAI Agent, trials: 1, reported by: OpenAI, date: 2026-06-22· CyberGym leaderboard data docs | 0.856 |
| 3 | GLM 5.3agent: Claude Code, trials: 1, reported by: Zhipu AI, date: 2026-08-14· CyberGym leaderboard data docs | 0.845 |
| 4 | DeepSeek V4 Proagent: DeepSeek Agent, trials: 1, reported by: DeepSeek, date: 2026-08-13· CyberGym leaderboard data docs | 0.833 |
| 5 | GPT 5.5agent: OpenAI Agent, trials: 1, reported by: OpenAI, date: 2026-04-23· CyberGym leaderboard data docs | 0.818 |
| 6 | Grok 4.6agent: Grok Build, trials: 1, reported by: xAI, date: 2026-08-12· CyberGym leaderboard data docs | 0.797 |
| 7 | GPT 5.4agent: OpenAI Agent, trials: 1, reported by: OpenAI, date: 2026-04-23· CyberGym leaderboard data docs | 0.79 |
| 8 | Grok 4.5agent: Grok Build, trials: 1, reported by: xAI, date: 2026-07-14· CyberGym leaderboard data docs | 0.79 |
| 9 | GLM 5.2agent: Claude Code, trials: 1, reported by: Zhipu AI, date: 2026-07-21· CyberGym leaderboard data docs | 0.772 |
| 10 | DeepSeek V4 Flashagent: DeepSeek Agent, trials: 1, reported by: DeepSeek, date: 2026-07-31· CyberGym leaderboard data docs | 0.767 |
| 11 | GLM 5.1agent: Claude Code, trials: 1, reported by: Zhipu AI, date: 2026-04-07· CyberGym leaderboard data docs | 0.687 |
| 12 | Claude Opus 4.6agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2026-02-05· CyberGym leaderboard data docs | 0.666 |
| 13 | GPT 5.4agent: Codex CLI, trials: 1, reported by: Zhipu AI, date: 2026-04-07· CyberGym leaderboard data docs | 0.663 |
| 14 | Claude Sonnet 4.6agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2026-02-17· CyberGym leaderboard data docs | 0.652 |
| 15 | Muse Spark 1.1agent: Meta Agent, model note: helpful-only, trials: 1, reported by: Meta AI, date: 2026-07-09· CyberGym leaderboard data docs | 0.59 |
| 16 | DeepSeek-V4-Pro Previewagent: Claude Code, trials: 1, reported by: XDxAI, date: 2026-07-13· CyberGym leaderboard data docs | 0.577 |
| 17 | Claude Opus 4.5agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2026-02-05· CyberGym leaderboard data docs | 0.506 |
| 18 | Muse Sparkagent: Meta Agent, trials: 1, reported by: Meta AI, date: 2026-04-14· CyberGym leaderboard data docs | 0.435 |
| 19 | GLM 5agent: Claude Code, trials: 1, reported by: Zhipu AI, date: 2026-02-12· CyberGym leaderboard data docs | 0.432 |
| 20 | Kimi K2.5agent: Kimi Agent, trials: 1, reported by: Kimi, date: 2026-02-02· CyberGym leaderboard data docs | 0.413 |
| 21 | GPT 5agent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-12-05· CyberGym leaderboard data docs | 0.394 |
| 22 | Gemini 3.1 Pro Previewagent: Gemini CLI, trials: 1, reported by: Zhipu AI, date: 2026-04-07· CyberGym leaderboard data docs | 0.388 |
| 23 | Claude Sonnet 4.5agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs | 0.289 |
| 24 | Claude Opus 4.1agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs | 0.25 |
| 25 | GLM 4.7agent: Claude Code, trials: 1, reported by: Zhipu AI, date: 2026-02-12· CyberGym leaderboard data docs | 0.235 |
| 26 | Claude Sonnet 4agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs | 0.226 |
| 27 | Claude Sonnet 4agent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-23· CyberGym leaderboard data docs | 0.179 |
| 28 | Claude Sonnet 3.7agent: Anthropic Agent, trials: 1, reported by: Anthropic, date: 2025-09-29· CyberGym leaderboard data docs | 0.145 |
| 29 | Claude Sonnet 3.7agent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.119 |
| 30 | GPT 4.1agent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0936 |
| 31 | GPT 4.1agent: Cybench, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0896 |
| 32 | GPT 4.1agent: Codex CLI, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0737 |
| 33 | GPT 4.1agent: ENiGMA, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0723 |
| 34 | Gemini 2.5 Flash Previewagent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0484 |
| 35 | DeepSeek V3agent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0358 |
| 36 | o4 Miniagent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0246 |
| 37 | Qwen 3 235B A22Bagent: OpenHands, trials: 1, reported by: CyberGym Team, date: 2025-05-15· CyberGym leaderboard data docs | 0.0186 |