Skip to content

Benchmark

OALL ALRAGE

Scores are percentages.

Models measured
51
Scores recorded
51
Sources
1
IQ weight
1.61

Score distribution

66.1%
Mean
73.2%
Median
16.3%
Std dev
43.1%
10th percentile
79.9%
90th percentile
3.5%
Min
3.5%80.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.61 for chat models, measured over 51 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 32B· Open Arabic LLM Leaderboard data80.7%
2Gemma 2 2B IT· Open Arabic LLM Leaderboard data80.6%
3Gemma 2 9B IT· Open Arabic LLM Leaderboard data80.5%
4gemma2-27b· Open Arabic LLM Leaderboard data80.5%
5Qwen3 30B A3B Instruct· Open Arabic LLM Leaderboard data80.4%
6Gemma 2 27B IT· Open Arabic LLM Leaderboard data79.9%
7Qwen3 14B· Open Arabic LLM Leaderboard data79.7%
8Aya Expanse 32B· Open Arabic LLM Leaderboard data79.6%
9Qwen2.5 32B Instruct· Open Arabic LLM Leaderboard data79.2%
10Qwen3 4B Instruct 2507· Open Arabic LLM Leaderboard data79.1%
11Qwen 2.5 32B Abliterated· Open Arabic LLM Leaderboard data79.1%
12Qwen 2.5 14B Instruct· Open Arabic LLM Leaderboard data78.9%
13Qwen2.5 72B Instruct· Open Arabic LLM Leaderboard data78.9%
14Qwen3 8B· Open Arabic LLM Leaderboard data78.2%
15Qwen2.5 72B· Open Arabic LLM Leaderboard data77.4%
16Qwen2.5 7B Instruct· Open Arabic LLM Leaderboard data77.4%
17Phi 4· Open Arabic LLM Leaderboard data77.2%
18Qwen2.5 32B· Open Arabic LLM Leaderboard data76.7%
19Qwen3 4B· Open Arabic LLM Leaderboard data76.3%
20C4AI Command R7b Arabic 02 2025· Open Arabic LLM Leaderboard data75.9%
21Llama 3.3 70B Instruct· Open Arabic LLM Leaderboard data75.8%
22Aya Expanse 8B· Open Arabic LLM Leaderboard data75.8%
23Qwen3 8B Base· Open Arabic LLM Leaderboard data74.1%
24Qwen 2 (72B)· Open Arabic LLM Leaderboard data73.4%
25Gemma 3 27B IT· Open Arabic LLM Leaderboard data73.3%
26Qwen3 14B Base· Open Arabic LLM Leaderboard data73.2%
27Qwen2.5 14B· Open Arabic LLM Leaderboard data72.7%
28Qwen2.5 3B Instruct· Open Arabic LLM Leaderboard data71.7%
29Qwen2 7B Instruct· Open Arabic LLM Leaderboard data71.1%
30Qwen3 4B Base· Open Arabic LLM Leaderboard data70.9%
31Phi 4 Mini· Open Arabic LLM Leaderboard data69.1%
32Qwen3 1.7B Base· Open Arabic LLM Leaderboard data66.3%
33Qwen2.5 7B· Open Arabic LLM Leaderboard data64.8%
34Qwen1.5-14B· Open Arabic LLM Leaderboard data62.9%
35DeepSeek R1 Distill Qwen 32B· Open Arabic LLM Leaderboard data61.7%
36Qwen2.5 1.5B Instruct· Open Arabic LLM Leaderboard data61.6%
37QwQ 32B· Open Arabic LLM Leaderboard data60.7%
38Qwen1.5-7B· Open Arabic LLM Leaderboard data59.9%
39DeepSeek R1 Distill Qwen 14B· Open Arabic LLM Leaderboard data55.9%
40Qwen2 1.5b Instruct· Open Arabic LLM Leaderboard data54.8%
41Qwen3 0.6B· Open Arabic LLM Leaderboard data53.5%
42Llama 3.2 3B· Open Arabic LLM Leaderboard data53.3%
43Llama 3.1 8B Instruct· Open Arabic LLM Leaderboard data49.9%
44Qwen1.5-4B· Open Arabic LLM Leaderboard data47.9%
45Llama 3.1 8B· Open Arabic LLM Leaderboard data47.1%
46Llama 3.2 1B· Open Arabic LLM Leaderboard data43.1%
47Qwen2.5 0.5b Instruct· Open Arabic LLM Leaderboard data42.6%
48Qwen1.5-1.8B· Open Arabic LLM Leaderboard data41.9%
49qwen2-0.5b-instruct· Open Arabic LLM Leaderboard data38.5%
50Gemma 3 27B Pt· Open Arabic LLM Leaderboard data24.2%

Showing 1–50 of 51 results.

Data credits: Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence)