Skip to content

Benchmark

OALL

Scores are percentages.

Models measured
51
Scores recorded
51
Sources
1
IQ weight
0.65

Score distribution

51.5%
Mean
52.5%
Median
13.8%
Std dev
34.2%
10th percentile
69.5%
90th percentile
23.7%
Min
23.7%74.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.65 for chat models, measured over 51 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Llama 3.3 70B Instruct· Open Arabic LLM Leaderboard data74.5%
2Qwen2.5 72B Instruct· Open Arabic LLM Leaderboard data72.4%
3Gemma 3 27B IT· Open Arabic LLM Leaderboard data71.4%
4Qwen 2 (72B)· Open Arabic LLM Leaderboard data70.1%
5Qwen2.5 32B Instruct· Open Arabic LLM Leaderboard data70%
6Qwen 2.5 32B Abliterated· Open Arabic LLM Leaderboard data69.5%
7Qwen2.5 72B· Open Arabic LLM Leaderboard data69.4%
8Qwen2.5 14B· Open Arabic LLM Leaderboard data68.5%
9Aya Expanse 32B· Open Arabic LLM Leaderboard data67.2%
10C4AI Command R7b Arabic 02 2025· Open Arabic LLM Leaderboard data67.1%
11Qwen3 8B Base· Open Arabic LLM Leaderboard data66.2%
12Qwen2.5 32B· Open Arabic LLM Leaderboard data65.5%
13Qwen2 7B Instruct· Open Arabic LLM Leaderboard data63.6%
14Gemma 3 27B Pt· Open Arabic LLM Leaderboard data63.2%
15Qwen 2.5 14B Instruct· Open Arabic LLM Leaderboard data63.2%
16Qwen3 4B Base· Open Arabic LLM Leaderboard data62.9%
17Qwen2.5 7B· Open Arabic LLM Leaderboard data61.1%
18Aya Expanse 8B· Open Arabic LLM Leaderboard data60.9%
19Qwen2.5 7B Instruct· Open Arabic LLM Leaderboard data59.8%
20Phi 4 Mini· Open Arabic LLM Leaderboard data55.8%
21Gemma 2 27B IT· Open Arabic LLM Leaderboard data55.5%
22Llama 3.1 8B Instruct· Open Arabic LLM Leaderboard data55.4%
23Qwen2.5 3B Instruct· Open Arabic LLM Leaderboard data54.2%
24Qwen3 14B Base· Open Arabic LLM Leaderboard data53.8%
25Qwen3 1.7B Base· Open Arabic LLM Leaderboard data52.9%
26Qwen1.5-14B· Open Arabic LLM Leaderboard data52.5%
27Llama 3.1 8B· Open Arabic LLM Leaderboard data51.6%
28Qwen2 1.5b Instruct· Open Arabic LLM Leaderboard data49.2%
29Qwen3 30B A3B Instruct· Open Arabic LLM Leaderboard data48.6%
30Qwen1.5-7B· Open Arabic LLM Leaderboard data47.2%
31Qwen2.5 1.5B Instruct· Open Arabic LLM Leaderboard data47.2%
32Gemma 2 9B IT· Open Arabic LLM Leaderboard data46.6%
33Phi 4· Open Arabic LLM Leaderboard data45.7%
34Qwen3 8B· Open Arabic LLM Leaderboard data42.4%
35Qwen3 32B· Open Arabic LLM Leaderboard data41.2%
36Llama 3.2 3B· Open Arabic LLM Leaderboard data41.1%
37Qwen3 14B· Open Arabic LLM Leaderboard data40.9%
38Qwen3 4B· Open Arabic LLM Leaderboard data39.9%
39Qwen1.5-4B· Open Arabic LLM Leaderboard data38.8%
40Qwen3 0.6B· Open Arabic LLM Leaderboard data38%
41Qwen3 4B Instruct 2507· Open Arabic LLM Leaderboard data36.9%
42gemma2-27b· Open Arabic LLM Leaderboard data35.6%
43qwen2-0.5b-instruct· Open Arabic LLM Leaderboard data35.6%
44DeepSeek R1 Distill Qwen 32B· Open Arabic LLM Leaderboard data35.1%
45Gemma 2 2B IT· Open Arabic LLM Leaderboard data34.7%
46Qwen2.5 0.5b Instruct· Open Arabic LLM Leaderboard data34.2%
47QwQ 32B· Open Arabic LLM Leaderboard data32.8%
48DeepSeek R1 Distill Qwen 14B· Open Arabic LLM Leaderboard data32.4%
49Llama 3.2 1B· Open Arabic LLM Leaderboard data30.2%
50Qwen1.5-1.8B· Open Arabic LLM Leaderboard data29.5%

Showing 1–50 of 51 results.

Data credits: Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence)