Skip to content

Benchmark

SecureSWE

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

60.7%
Mean
65.7%
Median
5%
Std dev
55.6%
10th percentile
65.7%
90th percentile
55.6%
Min
55.6%65.7%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1GPT-6.2 Astra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim65.7%
2GPT-6.2 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim55.6%

Data credits: Data by LLM Stats