Skip to content

Benchmark

SWE-bench Verified (Agentless)

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

43.8%
Mean
51.8%
Median
8.1%
Std dev
35.7%
10th percentile
51.8%
90th percentile
35.7%
Min
35.7%51.8%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Kimi K2 Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim51.8%
2MiMo V2.5 Pro· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim35.7%

Data credits: Data by LLM Stats