Skip to content

Benchmark

IndicParam Gujarati accuracy (zero-shot)

Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.

Models and systems measured
20
Scores recorded
20
Sources
1
IQ weight
1.03

Score distribution

32.9%
Mean
32.6%
Median
6.1%
Std dev
27.2%
10th percentile
39.5%
90th percentile
26.1%
Min
26.1%51.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.03 for chat models, measured over 15 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Data credits: Maheshwari et al., IndicParam, arXiv:2512.00333v3. Cited numeric scores under the owner's 2026-10-10 task-only restriction scope decision; no results licence established. Tasks, prompts and generations excluded.