Skip to content

Benchmark

AISG SEA-HELM (English)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
45
Scores recorded
45
Sources
1
IQ weight
1.87

Score distribution

50.9
Mean
52
Median
11.3
Std dev
37.4
10th percentile
64.1
90th percentile
19.4
Min
19.467.7
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.87 for chat models, measured over 45 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs67.7
2Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs66.1
3Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs66.1
4GLM 5.3· AI Singapore SEA-HELM Leaderboard docs64.9
5Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs64.1
6Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs63.6
7DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs63.3
8Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs62.5
9Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs61.8
10Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs60.6
11Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs59.8
12NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs59.3
13GLM 4.7· AI Singapore SEA-HELM Leaderboard docs59.1
14Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs58.1
15DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs58
16Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs57.4
17Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs56.8
18Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs56.6
19Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs55.9
20Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs55.6
21Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs54.8
22GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs53.7
23Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs52
24Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs49.5
25Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs49.4
26GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs49.3
27GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs49.1
28Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs48.8
29Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs48
30Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs47.5
31Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs47.2
32Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs46.7
33Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs46.1
34Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs44.9
35Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs44.6
36Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs43.8
37Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs40
38Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs38.8
39Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs38.1
40Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs37.8
41Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs37.4
42Olmo 3.1 32B Instruct· AI Singapore SEA-HELM Leaderboard docs35.2
43Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs27.1
44Llama 3.1 8B Instruct· AI Singapore SEA-HELM Leaderboard docs25
45Llama 3.2 3B· AI Singapore SEA-HELM Leaderboard docs19.4

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).