Skip to content

Benchmark

AISG SEA-HELM (Burmese)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.09

Score distribution

43.3
Mean
48.1
Median
21.4
Std dev
6.6
10th percentile
66.3
90th percentile
4.1
Min
4.170.1
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.09 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs70.1
2DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs69.7
3Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs69.2
4Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs68.9
5Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs66.7
6Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs66.3
7Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs65.9
8GLM 5.3· AI Singapore SEA-HELM Leaderboard docs65.9
9GLM 4.7· AI Singapore SEA-HELM Leaderboard docs65.3
10Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs65
11Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs64.7
12Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs64
13Inkling Small· AI Singapore SEA-HELM Leaderboard docs62.5
14DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs62.1
15MiniMax M3· AI Singapore SEA-HELM Leaderboard docs61.9
16Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs61.8
17Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs61.3
18Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs60.3
19Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs58.6
20Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs58.1
21Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs55.5
22DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs55.4
23Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs54.8
24Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs52.8
25Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs52.6
26Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs51.3
27Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs48.4
28Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs48.1
29Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs46.2
30GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs45.8
31Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs45
32Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs44.2
33Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs43.4
34Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs42.3
35Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs40.9
36Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs40.1
37Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs36.5
38Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs35
39GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs32.6
40Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs31.2
41Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs27.5
42Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs24.5
43NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs20.9
44Gemma 3 4B IT· AI Singapore SEA-HELM Leaderboard docs19.3
45GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs19.2
46Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs16.3
47Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs15.7
48Llama 3.1 8B Instruct· AI Singapore SEA-HELM Leaderboard docs9.3
49Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs7.9
50Olmo 3.1 32B Instruct· AI Singapore SEA-HELM Leaderboard docs6.6

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).