Skip to content

Benchmark

OALL AraTrust

Scores are percentages.

Models measured
51
Scores recorded
51
Sources
1
IQ weight
0.52

Score distribution

65.8%
Mean
72.5%
Median
20.2%
Std dev
31.2%
10th percentile
88.1%
90th percentile
30.2%
Min
30.2%89.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.52 for chat models, measured over 51 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen 2 (72B)· Open Arabic LLM Leaderboard data89.2%
2Qwen2.5 72B Instruct· Open Arabic LLM Leaderboard data89.2%
3Gemma 3 27B IT· Open Arabic LLM Leaderboard data89.1%
4Aya Expanse 32B· Open Arabic LLM Leaderboard data89%
5Qwen2.5 72B· Open Arabic LLM Leaderboard data88.6%
6Llama 3.3 70B Instruct· Open Arabic LLM Leaderboard data88.1%
7Gemma 3 27B Pt· Open Arabic LLM Leaderboard data87.8%
8Qwen 2.5 32B Abliterated· Open Arabic LLM Leaderboard data87%
9Qwen2.5 32B Instruct· Open Arabic LLM Leaderboard data86.7%
10Qwen2.5 14B· Open Arabic LLM Leaderboard data86.5%
11Qwen 2.5 14B Instruct· Open Arabic LLM Leaderboard data86.1%
12Qwen3 4B Base· Open Arabic LLM Leaderboard data84.9%
13Qwen3 8B Base· Open Arabic LLM Leaderboard data83.4%
14Qwen2.5 32B· Open Arabic LLM Leaderboard data83%
15Qwen2 7B Instruct· Open Arabic LLM Leaderboard data82.8%
16Aya Expanse 8B· Open Arabic LLM Leaderboard data82.5%
17Qwen2.5 7B Instruct· Open Arabic LLM Leaderboard data80.7%
18Gemma 2 27B IT· Open Arabic LLM Leaderboard data80.5%
19C4AI Command R7b Arabic 02 2025· Open Arabic LLM Leaderboard data80.5%
20Phi 4 Mini· Open Arabic LLM Leaderboard data77.8%
21Qwen2.5 7B· Open Arabic LLM Leaderboard data77.6%
22Gemma 2 9B IT· Open Arabic LLM Leaderboard data77.2%
23Llama 3.1 8B Instruct· Open Arabic LLM Leaderboard data75.6%
24Qwen3 1.7B Base· Open Arabic LLM Leaderboard data75.6%
25Qwen3 30B A3B Instruct· Open Arabic LLM Leaderboard data72.7%
26Qwen2.5 3B Instruct· Open Arabic LLM Leaderboard data72.5%
27Llama 3.1 8B· Open Arabic LLM Leaderboard data72%
28Qwen2.5 1.5B Instruct· Open Arabic LLM Leaderboard data70.8%
29Qwen2 1.5b Instruct· Open Arabic LLM Leaderboard data68.9%
30Qwen1.5-7B· Open Arabic LLM Leaderboard data67.2%
31Qwen1.5-14B· Open Arabic LLM Leaderboard data64.4%
32Llama 3.2 3B· Open Arabic LLM Leaderboard data58.5%
33Qwen3 14B Base· Open Arabic LLM Leaderboard data57.6%
34Qwen1.5-4B· Open Arabic LLM Leaderboard data57.2%
35Qwen3 8B· Open Arabic LLM Leaderboard data55.3%
36Qwen3 4B· Open Arabic LLM Leaderboard data52.8%
37Qwen3 0.6B· Open Arabic LLM Leaderboard data51.5%
38Qwen3 14B· Open Arabic LLM Leaderboard data51.2%
39Phi 4· Open Arabic LLM Leaderboard data47.6%
40Qwen2.5 0.5b Instruct· Open Arabic LLM Leaderboard data47.3%
41qwen2-0.5b-instruct· Open Arabic LLM Leaderboard data46.9%
42Qwen3 4B Instruct 2507· Open Arabic LLM Leaderboard data40.6%
43Qwen3 32B· Open Arabic LLM Leaderboard data38.9%
44Llama 3.2 1B· Open Arabic LLM Leaderboard data37.2%
45Qwen1.5-1.8B· Open Arabic LLM Leaderboard data31.5%
46DeepSeek R1 Distill Qwen 14B· Open Arabic LLM Leaderboard data31.2%
47DeepSeek R1 Distill Qwen 32B· Open Arabic LLM Leaderboard data31.2%
48Gemma 2 2B IT· Open Arabic LLM Leaderboard data31.2%
49gemma2-27b· Open Arabic LLM Leaderboard data31.2%
50QwQ 32B· Open Arabic LLM Leaderboard data31.2%

Showing 1–50 of 51 results.

Data credits: Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence)