Skip to content

Benchmark

NanoGPT

Coding benchmarks compare models on programming tasks. Scores are percentages. Higher is better.

Models measured
6
Scores recorded
9
Sources
2
IQ weight
0.89

Score distribution

12.4%
Mean
9.7%
Median
11.9%
Std dev
1.7%
10th percentile
14.6%
90th percentile
1.7%
Min
1.7%42.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.89 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT-6.2 Astra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim42.9%
2GPT-6.2 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim14.6%
3GPT-5.6 Terra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim14.5%
4GPT-5.6 TerraOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.14.5%
5GPT-5.6 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim9.7%
6GPT-5.6 SolOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.9.7%
7GPT 5.5OpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.2.7%
8GPT-5.6 Luna· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim1.7%
9GPT-5.6 LunaOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1.7%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · Data by LLM Stats