Skip to content

Benchmark

CRUXEval-Input-CoT

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
1
Scores recorded
1
Sources
1
IQ weight
No weight published

Score distribution

56.5%
Mean
56.5%
Median
0%
Std dev
56.5%
10th percentile
56.5%
90th percentile
56.5%
Min

Leaderboard

#ModelScore
1Qwen2.5 Coder 7B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim56.5%

Data credits: Data by LLM Stats