Skip to content

Benchmark

AISG SEA-HELM (Indonesian)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.72

Score distribution

66.6
Mean
67.8
Median
11.5
Std dev
50
10th percentile
79.1
90th percentile
31.6
Min
31.679.8
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.72 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs79.8
2Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs79.7
3GLM 5.3· AI Singapore SEA-HELM Leaderboard docs79.6
4Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs79.5
5GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs79.4
6Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs79.1
7DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs79
8Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs77
9Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs76.6
10GLM 4.7· AI Singapore SEA-HELM Leaderboard docs76.6
11DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs76.5
12MiniMax M3· AI Singapore SEA-HELM Leaderboard docs75.5
13Inkling Small· AI Singapore SEA-HELM Leaderboard docs75.4
14Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs75.4
15Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs75.3
16NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs75
17Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs74.9
18Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs74.1
19Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs74.1
20Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs73.6
21Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs73.4
22Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs73.1
23Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs71.2
24DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs71.1
25Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs70.8
26Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs68.7
27GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs68.2
28Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs67.8
29Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs66.9
30Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs66.7
31Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs66
32Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs65.4
33Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs65.3
34Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs65.1
35Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs64.3
36Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs63.5
37GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs63.1
38Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs62.7
39Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs62.6
40Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs62.5
41Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs62.3
42Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs62.3
43Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs61.9
44GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs61.7
45Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs61.1
46Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs60.2
47Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs60.2
48Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs57
49Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs54.4
50Llama 3.1 8B Instruct· AI Singapore SEA-HELM Leaderboard docs50

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).