Skip to content

Benchmark

Indigenous Americas Language Identification Full (Otomí, 3 examples per language)

Scores are percentages. Higher is better.

Models measured
1
Scores recorded
1
Sources
1
IQ weight
No weight published

Score distribution

74%
Mean
74%
Median
0%
Std dev
74%
10th percentile
74%
90th percentile
74%
Min

Leaderboard

#ModelScore
1GPT 4.1table: 2, language: Otomí, examples: 3· Indigenous Americas linguistic competence data docs74%

Data credits: Vasselli, Martínez Peguero, Hudi, Sakajo and Watanabe. Measuring Linguistic Competence of LLMs on Indigenous Languages of the Americas. EACL 2026, ©2026 ACL, CC BY 4.0. Numeric/protocol extract from Tables 1–4; random reference rows omitted. (licence)