Skip to content

Benchmark

SeaLLMs SeaBench public (Indonesian)

Multilingual benchmarks compare model performance across languages. Higher scores are better.

Models measured
32
Scores recorded
32
Sources
1
IQ weight
2.57

Score distribution

8
Mean
8.3
Median
1.1
Std dev
6.4
10th percentile
9
90th percentile
4.6
Min
4.69.1
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.57 for chat models, measured over 32 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Claude 3.5 Sonnetjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs9.1
2Claude Sonnet 3.7judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs9.1
3gemini-pro-1.5judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs9
4GPT 4ojudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs9
5Gemini 2.0 Flashjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.9
6GPT 4.1judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.8
7DeepSeek V3judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.8
8Claude Haiku 3.5judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.8
9GPT-4.1 minijudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.7
10Gemini 2.0 Flash Litejudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.6
11Qwen2.5 72B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.6
12Gemma 3 27B ITjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.6
13Gemini 1.5 Flashjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.5
14Gemma 3 12B ITjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.4
15Gemma 2 27B ITjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.4
16Gemma 2 9B ITjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.3
17GPT-4o minijudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.3
18Llama 4 Maverickjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.3
19Claude 3 Haikujudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8.1
20GPT-4.1 nanojudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs8
21Qwen 2.5 14B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.9
22Qwen2 72B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.9
23Llama 3.1 70B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.8
24Llama 3 70B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.8
25Llama 4 Scoutjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.6
26Gemma 3 4B ITjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs7.3
27Qwen2.5 7B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs6.8
28Llama 3.1 8B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs6.8
29Qwen2 7B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs6.4
30GLM-4-9b-chatjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs6.3
31Qwen2.5 3B Instructjudge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs5.5
32Mistral (7B) Instruct v0.3judge:GPT-4o-2024-08-06· SeaLLMs Leaderboard for SEA Languages data docs4.6

Data credits: SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.