Skip to content

Benchmark

AISG SEA-HELM (Malay)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.61

Score distribution

66.8
Mean
68.2
Median
11.2
Std dev
52.4
10th percentile
78.3
90th percentile
32
Min
3280.6
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.61 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs80.6
2GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs79.7
3Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs79.4
4DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs79.3
5GLM 5.3· AI Singapore SEA-HELM Leaderboard docs79.1
6Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs78.3
7GLM 4.7· AI Singapore SEA-HELM Leaderboard docs78.3
8Inkling Small· AI Singapore SEA-HELM Leaderboard docs77.9
9Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs77.6
10Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs77.4
11Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs77.2
12NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs77.1
13Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs76.6
14MiniMax M3· AI Singapore SEA-HELM Leaderboard docs75.9
15DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs75.5
16Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs74.5
17Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs74.4
18Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs74
19Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs73.7
20DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs73.1
21Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs72.4
22Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs72.2
23Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs71.1
24Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs70.9
25Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs70.7
26Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs69.5
27GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs68.9
28Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs68.2
29Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs68.1
30Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs68.1
31Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs68
32Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs67.7
33Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs66.1
34Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs64.5
35Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs64.4
36GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs63.9
37Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs62.5
38Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs62.3
39Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs62.3
40Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs62.3
41Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs61.8
42Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs61.4
43Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs61.2
44GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs60.5
45Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs59.4
46Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs58.8
47Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs57.4
48Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs56.4
49Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs55.8
50Olmo 3.1 32B Instruct· AI Singapore SEA-HELM Leaderboard docs52.4

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).