Skip to content

Benchmark

Irish-BLiMP shortfall relative to its named base model

Multilingual benchmarks compare model performance across languages.

Models and systems measured
1
Scores recorded
1
Sources
1
IQ weight
No weight published

Score distribution

0.2
Mean
0.2
Median
0
Std dev
0.2
10th percentile
0.2
90th percentile
0.2
Min

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
UCCIXsource: prose, comparison: Llama-2-13b· Irish-BLiMP (arXiv:2510.20957v1) data0.2

Data credits: Josh McGiff, Khanh-Tung Tran, William Mulcahy, Dáibhidh Ó Luinín, Jake Dalzell, Róisín Ní Bhroin, Adam Burke, Barry O'Sullivan, Hoang D. Nguyen and Nikola S. Nikolov. Irish-BLiMP, arXiv:2510.20957v1, submitted 2025-10-23. CC BY 4.0 article numeric/protocol extract; restructured, printed values unchanged. No task, prompt or model rights asserted. (licence)