Skip to content

Benchmark

AISG SEA-HELM (Tamil)

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100. Higher is better.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
1.81

Score distribution

56.7
Mean
62.2
Median
19.6
Std dev
22.5
10th percentile
74.1
90th percentile
3.3
Min
3.378.6
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.81 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Inkling FP4quantization:NVFP4· AI Singapore SEA-HELM Leaderboard docs78.6
2GLM 5.2quantization:FP8· AI Singapore SEA-HELM Leaderboard docs76.5
3Qwen3.5 397B A17B· AI Singapore SEA-HELM Leaderboard docs76.2
4GLM 5.3· AI Singapore SEA-HELM Leaderboard docs75.8
5DeepSeek V4 Pro· AI Singapore SEA-HELM Leaderboard docs75.7
6Gemma 4 31B IT· AI Singapore SEA-HELM Leaderboard docs74.1
7Inkling Small· AI Singapore SEA-HELM Leaderboard docs74
8Qwen3.5 122B-A10B· AI Singapore SEA-HELM Leaderboard docs73.1
9GLM 4.7· AI Singapore SEA-HELM Leaderboard docs72.9
10MiniMax M3· AI Singapore SEA-HELM Leaderboard docs72.9
11DeepSeek V4 Flash 0731· AI Singapore SEA-HELM Leaderboard docs72.8
12Gemma 4 26B A4B· AI Singapore SEA-HELM Leaderboard docs72.2
13Muse Glimmer 30B· AI Singapore SEA-HELM Leaderboard docs71.7
14Qwen3.5 27B· AI Singapore SEA-HELM Leaderboard docs71.6
15Qwen3.6 35B A3B· AI Singapore SEA-HELM Leaderboard docs71.2
16Qwen3.5 35B A3B· AI Singapore SEA-HELM Leaderboard docs71.1
17DeepSeek V4 Flash· AI Singapore SEA-HELM Leaderboard docs70.3
18Qwen3.6 27B· AI Singapore SEA-HELM Leaderboard docs70.3
19Qwen 3.8 27B· AI Singapore SEA-HELM Leaderboard docs67.1
20Qwen3 VL 235B· AI Singapore SEA-HELM Leaderboard docs66.8
21Qwen3.5 9B· AI Singapore SEA-HELM Leaderboard docs66.5
22Mistral Medium 3.5 128b· AI Singapore SEA-HELM Leaderboard docs66.2
23Qwen 3.8 Flash Next· AI Singapore SEA-HELM Leaderboard docs65.8
24Gemma 4 12B It· AI Singapore SEA-HELM Leaderboard docs65.6
25Qwen3 32B· AI Singapore SEA-HELM Leaderboard docs64.4
26Qwen3 VL 32B Instruct· AI Singapore SEA-HELM Leaderboard docs63.7
27NVIDIA Nemotron 3.5 Super VL 120B· AI Singapore SEA-HELM Leaderboard docs63.4
28GPT OSS 120Bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs62.2
29Qwen3 14B· AI Singapore SEA-HELM Leaderboard docs61.1
30Llama 4 Maverick· AI Singapore SEA-HELM Leaderboard docs61
31Nemotron 3 Ultra· AI Singapore SEA-HELM Leaderboard docs60.9
32Gemma 4 E4B-it· AI Singapore SEA-HELM Leaderboard docs60.7
33Nemotron 3.5 Bolt E4b· AI Singapore SEA-HELM Leaderboard docs60.7
34Gemma 3 12B IT· AI Singapore SEA-HELM Leaderboard docs58.7
35Llama 4 Scout· AI Singapore SEA-HELM Leaderboard docs58.5
36Qwen3.5 4B· AI Singapore SEA-HELM Leaderboard docs58.2
37GPT OSS 20bquantization:mxfp4· AI Singapore SEA-HELM Leaderboard docs57.7
38Gemma 3 27B IT· AI Singapore SEA-HELM Leaderboard docs57.6
39Command A Plus 05 2026· AI Singapore SEA-HELM Leaderboard docs56
40Llama 3.3 70B Instruct· AI Singapore SEA-HELM Leaderboard docs54.9
41Gemma 4 E2B-it· AI Singapore SEA-HELM Leaderboard docs54.6
42Qwen3 8B· AI Singapore SEA-HELM Leaderboard docs47.7
43Qwen Sea Lion v4 8b VL· AI Singapore SEA-HELM Leaderboard docs47.5
44Qwen3 VL 8B Instruct· AI Singapore SEA-HELM Leaderboard docs46.2
45Gemma 3 4B IT· AI Singapore SEA-HELM Leaderboard docs40.3
46Llama Sea Lion v3 8b It· AI Singapore SEA-HELM Leaderboard docs37
47GLM 4.7 Flash· AI Singapore SEA-HELM Leaderboard docs36.7
48Olmo 3.1 32B Instruct· AI Singapore SEA-HELM Leaderboard docs24.9
49Nemotron 3 Super 120B A12B· AI Singapore SEA-HELM Leaderboard docs22.5
50Nemotron 3 Nano 30B A3B· AI Singapore SEA-HELM Leaderboard docs22.5

Showing 1–50 of 55 results.

Data credits: SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT).