Skip to content

Benchmark

Gorilla Benchmark API Bench

Coding benchmarks compare models on programming tasks. Scores are percentages.

Models measured
3
Scores recorded
3
Sources
1
IQ weight
No weight published

Score distribution

24.4%
Mean
29.7%
Median
11.7%
Std dev
8.2%
10th percentile
35.3%
90th percentile
8.2%
Min
8.2%35.3%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Llama 3.1 405B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim35.3%
2Llama 3.1 70B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim29.7%
3Llama 3.1 8B Instruct· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim8.2%

Data credits: Data by LLM Stats