Skip to content

Benchmark

Parametric CAD Bench v3

Scores are percentages.

Models measured
11
Scores recorded
11
Sources
1
IQ weight
0.92

Score distribution

37.9%
Mean
34.8%
Median
15%
Std dev
20.9%
10th percentile
56.9%
90th percentile
17.2%
Min
17.2%61%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.92 for chat models, measured over 11 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Tokens per task, input and output together, as measured by the source. Comparable within this benchmark only.