Skip to content

Benchmark

INCLUDE-base-44 0-shot arabic (Speakleash)

Higher scores are better.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
0.75

Score distribution

0.507
Mean
0.52
Median
0.091
Std dev
0.399
10th percentile
0.623
90th percentile
0.384
Min
0.3840.623
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.75 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: Speakleash community evaluation of INCLUDE-base-44 (Romanou et al., arXiv:2411.19799). Public results.csv; no results licence stated.