Skip to content

Benchmark

IndicParam Identify incorrect statement questions accuracy (all sets pooled, zero-shot)

Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.

Models and systems measured
20
Scores recorded
20
Sources
1
IQ weight
0.93

Score distribution

34.4%
Mean
35.6%
Median
8.4%
Std dev
25.5%
10th percentile
43.3%
90th percentile
22.4%
Min
22.4%58.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.93 for chat models, measured over 15 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Data credits: Maheshwari et al., IndicParam, arXiv:2512.00333v3. Cited numeric scores under the owner's 2026-10-10 task-only restriction scope decision; no results licence established. Tasks, prompts and generations excluded.