Skip to content

Benchmark

Gray Swan IPI Benchmark

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

3%
Mean
6%
Median
3%
Std dev
0%
10th percentile
6%
90th percentile
0%
Min
0%6%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Gemini 3.8 Flash Cyber· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim6%
2Gemini 4 Carbon· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim0%

Data credits: Data by LLM Stats