Skip to content

Benchmark

Vals Vibe Code Bench 1-100 v1.1

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
10
Scores recorded
10
Sources
1
IQ weight
2.72

Score distribution

33%
Mean
29.8%
Median
11.1%
Std dev
24.5%
10th percentile
49.7%
90th percentile
19.8%
Min
19.8%55.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.72 for chat models, measured over 10 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard