Skip to content

Benchmark

DevOps-Eval release

Scores are percentages. Higher is better.

Models measured
1
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

87.3%
Mean
89.6%
Median
2.4%
Std dev
84.9%
10th percentile
89.6%
90th percentile
84.9%
Min
84.9%89.6%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

Data credits: Codefuse DevOps-Eval. Copyright 2023 Ant Group. Licensed under the Apache License, Version 2.0. Historical 2023 snapshot. (Apache-2.0 licence)