Skip to content

Benchmark

IndicParam Santali language understanding questions accuracy (zero-shot)

Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.

Models and systems measured
20
Scores recorded
20
Sources
1
IQ weight
1.04

Score distribution

38.9%
Mean
36.4%
Median
6.8%
Std dev
32.3%
10th percentile
47.5%
90th percentile
28.3%
Min
28.3%57.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.04 for chat models, measured over 15 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Data credits: Maheshwari et al., IndicParam, arXiv:2512.00333v3. Cited numeric scores under the owner's 2026-10-10 task-only restriction scope decision; no results licence established. Tasks, prompts and generations excluded.