Benchmark
CulturALL Hard
Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.
- Models measured
- 8
- Scores recorded
- 15
- Sources
- 1
- IQ weight
- 0.74
Score distribution
- 9.2%
- Mean
- 9.3%
- Median
- 4%
- Std dev
- 4.7%
- 10th percentile
- 15.5%
- 90th percentile
- 4.2%
- Min
This benchmark has a weight of 0.74 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
Data credits: Lin et al., CulturALL: Benchmarking Multilingual and Multicultural Competence of LLMs on Grounded Tasks, arXiv:2604.19262v1, CC BY 4.0. Table 2 scores extracted without change. (licence)