Skip to content

Benchmark

SeaLLMs SeaExam private (Indonesian)

Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.

Models measured
57
Scores recorded
57
Sources
1
IQ weight
1.42

Score distribution

63.8%
Mean
64.8%
Median
13.4%
Std dev
45.7%
10th percentile
79.9%
90th percentile
30.5%
Min
30.5%88.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.42 for chat models, measured over 57 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini 2.5 Pro Preview 03-25· SeaLLMs Leaderboard for SEA Languages data docs88.1%
2Claude 3.5 Sonnet· SeaLLMs Leaderboard for SEA Languages data docs83.9%
3DeepSeek V3· SeaLLMs Leaderboard for SEA Languages data docs83.1%
4gemini-pro-1.5· SeaLLMs Leaderboard for SEA Languages data docs81.9%
5Claude Sonnet 3.7· SeaLLMs Leaderboard for SEA Languages data docs80.4%
6Qwen2.5 72B· SeaLLMs Leaderboard for SEA Languages data docs80.1%
7Gemini 2.0 Flash Lite· SeaLLMs Leaderboard for SEA Languages data docs79.9%
8Qwen2 72B Instruct· SeaLLMs Leaderboard for SEA Languages data docs79.9%
9Qwen2.5 72B Instruct· SeaLLMs Leaderboard for SEA Languages data docs79.9%
10Gemini 2.0 Flash· SeaLLMs Leaderboard for SEA Languages data docs79.2%
11Llama 4 Maverick· SeaLLMs Leaderboard for SEA Languages data docs78.7%
12Qwen 2 (72B)· SeaLLMs Leaderboard for SEA Languages data docs78.2%
13Gemma 3 27B Pt· SeaLLMs Leaderboard for SEA Languages data docs75.4%
14Qwen 2.5 14B Instruct· SeaLLMs Leaderboard for SEA Languages data docs75.2%
15Llama 3.1 70B Instruct· SeaLLMs Leaderboard for SEA Languages data docs74.4%
16Qwen2.5 14B· SeaLLMs Leaderboard for SEA Languages data docs74.4%
17GPT 4.1· SeaLLMs Leaderboard for SEA Languages data docs73.7%
18Gemma 3 27B IT· SeaLLMs Leaderboard for SEA Languages data docs72.5%
19GPT-4.1 mini· SeaLLMs Leaderboard for SEA Languages data docs72.2%
20GPT 4o· SeaLLMs Leaderboard for SEA Languages data docs72%
21Llama 3 70B Instruct· SeaLLMs Leaderboard for SEA Languages data docs72%
22Gemini 1.5 Flash· SeaLLMs Leaderboard for SEA Languages data docs71%
23Llama 4 Scout· SeaLLMs Leaderboard for SEA Languages data docs70.2%
24Gemma 2 27B IT· SeaLLMs Leaderboard for SEA Languages data docs68.5%
25Llama 3.1 70B· SeaLLMs Leaderboard for SEA Languages data docs67.7%
26Qwen2.5 7B· SeaLLMs Leaderboard for SEA Languages data docs67%
27Qwen2.5 7B Instruct· SeaLLMs Leaderboard for SEA Languages data docs67%
28Claude Haiku 3.5· SeaLLMs Leaderboard for SEA Languages data docs66.5%
29Meta Llama 3 70b· SeaLLMs Leaderboard for SEA Languages data docs64.8%
30Gemma 3 12B IT· SeaLLMs Leaderboard for SEA Languages data docs63.3%
31GPT-4o mini· SeaLLMs Leaderboard for SEA Languages data docs63.3%
32Gemma 2 9B IT· SeaLLMs Leaderboard for SEA Languages data docs62.8%
33GLM 4 9B 0414· SeaLLMs Leaderboard for SEA Languages data docs62.3%
34gemma2-27b· SeaLLMs Leaderboard for SEA Languages data docs61.8%
35gemma-2-9b· SeaLLMs Leaderboard for SEA Languages data docs59.8%
36Qwen2 7B Instruct· SeaLLMs Leaderboard for SEA Languages data docs59.6%
37GPT-4.1 nano· SeaLLMs Leaderboard for SEA Languages data docs59.3%
38Qwen2.5 3B Instruct· SeaLLMs Leaderboard for SEA Languages data docs59.1%
39Claude 3 Haiku· SeaLLMs Leaderboard for SEA Languages data docs56.8%
40Llama 3.1 8B Instruct· SeaLLMs Leaderboard for SEA Languages data docs56.6%
41GLM-4-9b-chat· SeaLLMs Leaderboard for SEA Languages data docs55.6%
42Llama 3.1 8B· SeaLLMs Leaderboard for SEA Languages data docs55.3%
43Mixtral 8X7b V0.1· SeaLLMs Leaderboard for SEA Languages data docs53.1%
44Meta Llama 3 8b· SeaLLMs Leaderboard for SEA Languages data docs52.6%
45Qwen2.5 1.5B Instruct· SeaLLMs Leaderboard for SEA Languages data docs52.4%
46Gemma 3 4B IT· SeaLLMs Leaderboard for SEA Languages data docs52.1%
47Aya Expanse 8B· SeaLLMs Leaderboard for SEA Languages data docs51.9%
48Mixtral 8x7B Instruct v0.1· SeaLLMs Leaderboard for SEA Languages data docs51.4%
49Llama 3 8B Instruct· SeaLLMs Leaderboard for SEA Languages data docs51.1%
50Qwen2.5 1.5B· SeaLLMs Leaderboard for SEA Languages data docs50.6%

Showing 1–50 of 57 results.

Data credits: SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.