Skip to content

Benchmark

AISG SEA-HELM (Filipino)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.74

Score distribution

65
Mean
67.5
Median
12.8
Std dev
53.5
10th percentile
76.8
90th percentile
23.8
Min
23.878.9
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.74 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs78.9
2Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs78.2
3GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs78.2
4DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs77.7
5Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs77.7
6GLM 5.3· AI Singapore SEA-HELM Leaderboard docs76.8
7Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs76.2
8Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs76.1
9NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs76.1
10Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs75.7
11Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs75.5
12GLM 4.7· AI Singapore SEA-HELM Leaderboard docs74.9
13Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs74.6
14Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs74.4
15Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs74.3
16MiniMax M3· AI Singapore SEA-HELM Leaderboard docs74
17Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs73.7
18Inkling Small· AI Singapore SEA-HELM Leaderboard docs72.1
19DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs71.3
20GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs71
21Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs70.9
22Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs70.8
23Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs70.5
24Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs70.3
25Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs70
26Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs69.7
27DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs68.4
28Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs67.5
29Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs66.8
30Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs66.5
31Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs66.2
32Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs66.1
33Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs65.8
34Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs65.7
35Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs65.7
36Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs65.2
37Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs64.7
38Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs64.2
39GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs63.3
40GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs62.2
41Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs59.4
42Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs59.2
43Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs59
44Nemotron 3.5 Lightning 30B A3B· AI Singapore SEA-HELM Leaderboard docs58.5
45Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs56.8
46Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs55.3
47Gemma 3 4B IT· AI Singapore SEA-HELM Leaderboard docs54.2
48Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs54.2
49Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs54.1
50Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs53.5

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).