Skip to content

Benchmark

OALL EXAMS

Scores are percentages.

Models measured
51
Scores recorded
51
Sources
1
IQ weight
0.61

Score distribution

38.6%
Mean
35.8%
Median
12.9%
Std dev
23.7%
10th percentile
55.1%
90th percentile
21.2%
Min
21.2%66.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.61 for chat models, measured over 51 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Llama 3.3 70B Instruct· Open Arabic LLM Leaderboard data66.7%
2C4AI Command R7b Arabic 02 2025· Open Arabic LLM Leaderboard data65%
3Qwen2.5 72B Instruct· Open Arabic LLM Leaderboard data58.7%
4Gemma 3 27B IT· Open Arabic LLM Leaderboard data57.5%
5Gemma 3 27B Pt· Open Arabic LLM Leaderboard data57.4%
6Qwen2.5 32B Instruct· Open Arabic LLM Leaderboard data55.1%
7Qwen 2 (72B)· Open Arabic LLM Leaderboard data53.8%
8Qwen 2.5 14B Instruct· Open Arabic LLM Leaderboard data53.6%
9Qwen 2.5 32B Abliterated· Open Arabic LLM Leaderboard data53.3%
10Qwen2.5 14B· Open Arabic LLM Leaderboard data53.3%
11Qwen3 8B Base· Open Arabic LLM Leaderboard data52.5%
12Aya Expanse 32B· Open Arabic LLM Leaderboard data51%
13Llama 3.1 8B Instruct· Open Arabic LLM Leaderboard data50.3%
14Qwen2.5 32B· Open Arabic LLM Leaderboard data49.5%
15Qwen2.5 7B· Open Arabic LLM Leaderboard data49.2%
16Qwen3 4B Base· Open Arabic LLM Leaderboard data48.2%
17Qwen2 7B Instruct· Open Arabic LLM Leaderboard data47.3%
18Qwen2.5 72B· Open Arabic LLM Leaderboard data46.4%
19Aya Expanse 8B· Open Arabic LLM Leaderboard data45.4%
20Qwen3 14B Base· Open Arabic LLM Leaderboard data43.2%
21Qwen2.5 3B Instruct· Open Arabic LLM Leaderboard data43%
22Llama 3.1 8B· Open Arabic LLM Leaderboard data40%
23Qwen2.5 7B Instruct· Open Arabic LLM Leaderboard data39.7%
24Qwen3 1.7B Base· Open Arabic LLM Leaderboard data38.2%
25Qwen3 30B A3B Instruct· Open Arabic LLM Leaderboard data37.8%
26Phi 4 Mini· Open Arabic LLM Leaderboard data35.8%
27Qwen1.5-14B· Open Arabic LLM Leaderboard data35.4%
28Qwen2 1.5b Instruct· Open Arabic LLM Leaderboard data35.2%
29Phi 4· Open Arabic LLM Leaderboard data34.6%
30Qwen1.5-7B· Open Arabic LLM Leaderboard data32.6%
31Llama 3.2 3B· Open Arabic LLM Leaderboard data32.2%
32Qwen2.5 1.5B Instruct· Open Arabic LLM Leaderboard data31.8%
33Qwen3 8B· Open Arabic LLM Leaderboard data29.8%
34qwen2-0.5b-instruct· Open Arabic LLM Leaderboard data28.5%
35Gemma 2 9B IT· Open Arabic LLM Leaderboard data27.9%
36Qwen3 32B· Open Arabic LLM Leaderboard data27.9%
37Qwen3 4B· Open Arabic LLM Leaderboard data27.6%
38Qwen3 14B· Open Arabic LLM Leaderboard data27.2%
39Qwen2.5 0.5b Instruct· Open Arabic LLM Leaderboard data26.1%
40Qwen3 0.6B· Open Arabic LLM Leaderboard data25%
41Qwen1.5-4B· Open Arabic LLM Leaderboard data24.6%
42Gemma 2 27B IT· Open Arabic LLM Leaderboard data24.4%
43Qwen1.5-1.8B· Open Arabic LLM Leaderboard data23.8%
44DeepSeek R1 Distill Qwen 32B· Open Arabic LLM Leaderboard data23.7%
45Gemma 2 2B IT· Open Arabic LLM Leaderboard data23.7%
46gemma2-27b· Open Arabic LLM Leaderboard data23.7%
47QwQ 32B· Open Arabic LLM Leaderboard data23.7%
48DeepSeek R1 Distill Qwen 14B· Open Arabic LLM Leaderboard data23.5%
49Qwen2.5 1.5B· Open Arabic LLM Leaderboard data22.5%
50Qwen3 4B Instruct 2507· Open Arabic LLM Leaderboard data22%

Showing 1–50 of 51 results.

Data credits: Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence)