Skip to content

Benchmark

Deepswe Runs

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
26
Scores recorded
26
Sources
1
IQ weight
No weight published

Score distribution

4%
Mean
4%
Median
0%
Std dev
4%
10th percentile
4%
90th percentile
4%
Min

Leaderboard

Tokens the model generated per task, as measured by the source. Comparable within this benchmark only.

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)