Skip to content

Benchmark

DevOps-Eval code

Coding benchmarks compare models on programming tasks. Scores are percentages. Higher is better.

Models measured
1
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

75.7%
Mean
76%
Median
0.3%
Std dev
75.4%
10th percentile
76%
90th percentile
75.4%
Min
75.4%76%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

Data credits: Codefuse DevOps-Eval. Copyright 2023 Ant Group. Licensed under the Apache License, Version 2.0. Historical 2023 snapshot. (Apache-2.0 licence)