Skip to content

Benchmark

AISG SEA-HELM (Vietnamese)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.54

Score distribution

64.4
Mean
65.2
Median
12
Std dev
47.4
10th percentile
77.2
90th percentile
27.8
Min
27.879.1
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.54 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs79.1
2Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs78.4
3Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs78.1
4Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs77.7
5Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs77.5
6DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs77.2
7GLM 5.3· AI Singapore SEA-HELM Leaderboard docs77
8Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs76
9Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs75.7
10GLM 4.7· AI Singapore SEA-HELM Leaderboard docs75.6
11Inkling Small· AI Singapore SEA-HELM Leaderboard docs75.4
12Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs75
13Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs74.3
14Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs74
15MiniMax M3· AI Singapore SEA-HELM Leaderboard docs73.5
16DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs73.2
17Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs73.2
18NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs73
19Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs72.8
20Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs72.5
21Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs70.7
22Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs69.6
23Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs68.9
24DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs68.9
25Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs68.8
26Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs67.6
27GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs65.9
28Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs65.2
29Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs64.5
30Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs64.1
31Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs64.1
32Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs63.1
33Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs63
34Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs62.5
35Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs61.7
36Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs60.9
37Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs60.8
38Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs60.8
39Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs60.8
40Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs60.6
41GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs60.2
42Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs59.5
43Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs59.3
44Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs58.5
45Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs58.4
46GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs57.5
47Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs55.5
48Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs52.9
49Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs52
50Olmo 3.1 32B Instruct· AI Singapore SEA-HELM Leaderboard docs47.4

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).