Skip to content

Benchmark

AISG SEA-HELM (Thai)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.71

Score distribution

59
Mean
60.7
Median
13.9
Std dev
42.1
10th percentile
72.3
90th percentile
6.9
Min
6.974
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.71 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs74
2Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs73.2
3Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs73.2
4Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs73.1
5DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs72.4
6GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs72.3
7Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs71.5
8Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs71.1
9GLM 5.3· AI Singapore SEA-HELM Leaderboard docs70.6
10NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs70.5
11Inkling Small· AI Singapore SEA-HELM Leaderboard docs70.3
12GLM 4.7· AI Singapore SEA-HELM Leaderboard docs70.3
13Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs69.8
14Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs69.4
15MiniMax M3· AI Singapore SEA-HELM Leaderboard docs68.6
16Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs68.3
17Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs68.1
18Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs67.9
19DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs66.6
20Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs66.4
21Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs65.3
22Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs64.9
23DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs63.3
24Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs62.8
25GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs62.4
26Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs61.8
27Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs61.1
28Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs60.7
29Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs60.3
30Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs59.8
31Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs59.2
32Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs59.2
33Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs58.5
34Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs58.5
35Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs58.3
36Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs57.4
37Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs56.9
38Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs56.4
39Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs56.1
40Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs55.4
41GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs55.3
42Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs54.4
43GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs54
44Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs53.3
45Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs53.2
46Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs52.8
47Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs52.6
48Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs52.4
49Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs46.2
50Gemma 3 4B IT· AI Singapore SEA-HELM Leaderboard docs42.1

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).