Skip to content

Benchmark

AISG SEA-HELM

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.53

Score distribution

60.2
Mean
63
Median
14
Std dev
43.4
10th percentile
75
90th percentile
19.1
Min
19.176.5
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.53 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs76.5
2Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs76.5
3Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs76.3
4DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs75.9
5Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs75.7
6GLM 5.3· AI Singapore SEA-HELM Leaderboard docs75
7Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs73.8
8Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs73.6
9Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs73.5
10GLM 4.7· AI Singapore SEA-HELM Leaderboard docs73.4
11Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs72.7
12Inkling Small· AI Singapore SEA-HELM Leaderboard docs72.5
13Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs71.9
14MiniMax M3· AI Singapore SEA-HELM Leaderboard docs71.8
15Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs71.3
16DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs70.8
17Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs70.5
18Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs70.3
19Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs68.5
20DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs67.6
21Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs67.5
22Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs66.5
23NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs65.1
24Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs64.9
25Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs64.9
26Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs63.9
27GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs63.5
28Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs63
29Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs62.5
30Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs61.3
31Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs60.8
32Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs60.6
33Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs60.4
34Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs59.8
35Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs59.1
36Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs58
37Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs58
38Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs57.5
39GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs55.5
40Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs55
41Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs53.9
42Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs53.6
43Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs51.8
44Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs51.4
45GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs51.3
46Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs48.1
47Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs46.4
48Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs45.4
49Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs45.2
50Gemma 3 4B IT· AI Singapore SEA-HELM Leaderboard docs43.4

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).