Skip to content

Benchmark

KernelGen 1P

Coding benchmarks compare models on programming tasks. Scores are percentages. Higher is better.

Models measured
6
Scores recorded
9
Sources
2
IQ weight
0.55

Score distribution

49.6%
Mean
49.2%
Median
19.8%
Std dev
22.4%
10th percentile
74.7%
90th percentile
22.4%
Min
22.4%76.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.55 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT-6.2 Astra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim76.9%
2GPT-6.2 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim74.7%
3GPT-5.6 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim61.1%
4GPT-5.6 SolOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.61.1%
5GPT-5.6 Terra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim49.2%
6GPT-5.6 TerraOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.49.2%
7GPT 5.5OpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.29.3%
8GPT-5.6 Luna· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim22.4%
9GPT-5.6 LunaOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.22.4%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · Data by LLM Stats