Skip to content

Benchmark

OALL AlGhafa

Scores are percentages.

Models measured
51
Scores recorded
51
Sources
1
IQ weight
0.51

Score distribution

57.2%
Mean
57.1%
Median
17%
Std dev
32.7%
10th percentile
77.9%
90th percentile
30.9%
Min
30.9%80.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.51 for chat models, measured over 51 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Llama 3.3 70B Instruct· Open Arabic LLM Leaderboard data80.4%
2Qwen 2 (72B)· Open Arabic LLM Leaderboard data78.6%
3Qwen2.5 72B Instruct· Open Arabic LLM Leaderboard data78.2%
4Qwen2.5 32B Instruct· Open Arabic LLM Leaderboard data78.1%
5Qwen 2.5 32B Abliterated· Open Arabic LLM Leaderboard data78.1%
6Gemma 3 27B IT· Open Arabic LLM Leaderboard data77.9%
7Aya Expanse 32B· Open Arabic LLM Leaderboard data77.6%
8Qwen2.5 72B· Open Arabic LLM Leaderboard data77.2%
9Qwen2.5 14B· Open Arabic LLM Leaderboard data77.2%
10Qwen2.5 32B· Open Arabic LLM Leaderboard data77.1%
11Gemma 3 27B Pt· Open Arabic LLM Leaderboard data76.1%
12Qwen3 8B Base· Open Arabic LLM Leaderboard data74.8%
13C4AI Command R7b Arabic 02 2025· Open Arabic LLM Leaderboard data74.8%
14Qwen2 7B Instruct· Open Arabic LLM Leaderboard data73.2%
15Qwen 2.5 14B Instruct· Open Arabic LLM Leaderboard data72.3%
16Gemma 2 27B IT· Open Arabic LLM Leaderboard data72.2%
17Qwen2.5 7B· Open Arabic LLM Leaderboard data72.2%
18Llama 3.1 8B Instruct· Open Arabic LLM Leaderboard data70.9%
19Phi 4 Mini· Open Arabic LLM Leaderboard data69.3%
20Qwen3 4B Base· Open Arabic LLM Leaderboard data68.5%
21Aya Expanse 8B· Open Arabic LLM Leaderboard data66.7%
22Qwen1.5-14B· Open Arabic LLM Leaderboard data65.7%
23Qwen2.5 7B Instruct· Open Arabic LLM Leaderboard data65.6%
24Llama 3.1 8B· Open Arabic LLM Leaderboard data64.3%
25Qwen2.5 3B Instruct· Open Arabic LLM Leaderboard data61.1%
26Qwen3 14B Base· Open Arabic LLM Leaderboard data57.1%
27Qwen3 1.7B Base· Open Arabic LLM Leaderboard data56.8%
28Qwen2 1.5b Instruct· Open Arabic LLM Leaderboard data53.1%
29Qwen1.5-7B· Open Arabic LLM Leaderboard data52.3%
30Qwen3 30B A3B Instruct· Open Arabic LLM Leaderboard data50.9%
31Qwen2.5 1.5B Instruct· Open Arabic LLM Leaderboard data48.4%
32Gemma 2 9B IT· Open Arabic LLM Leaderboard data47.9%
33Qwen3 32B· Open Arabic LLM Leaderboard data46.8%
34DeepSeek R1 Distill Qwen 32B· Open Arabic LLM Leaderboard data46.5%
35Qwen3 8B· Open Arabic LLM Leaderboard data44.6%
36Qwen3 0.6B· Open Arabic LLM Leaderboard data44.1%
37Llama 3.2 3B· Open Arabic LLM Leaderboard data42.9%
38Qwen1.5-4B· Open Arabic LLM Leaderboard data42.4%
39Phi 4· Open Arabic LLM Leaderboard data42.3%
40qwen2-0.5b-instruct· Open Arabic LLM Leaderboard data40.6%
41Qwen2.5 0.5b Instruct· Open Arabic LLM Leaderboard data40.4%
42Qwen3 4B· Open Arabic LLM Leaderboard data38.7%
43Qwen3 4B Instruct 2507· Open Arabic LLM Leaderboard data36.5%
44Gemma 2 2B IT· Open Arabic LLM Leaderboard data34.1%
45Llama 3.2 1B· Open Arabic LLM Leaderboard data33.9%
46Qwen1.5-1.8B· Open Arabic LLM Leaderboard data32.7%
47DeepSeek R1 Distill Qwen 14B· Open Arabic LLM Leaderboard data32.6%
48Qwen3 14B· Open Arabic LLM Leaderboard data32.1%
49gemma2-27b· Open Arabic LLM Leaderboard data31.3%
50QwQ 32B· Open Arabic LLM Leaderboard data31.3%

Showing 1–50 of 51 results.

Data credits: Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence)