Skip to content

Benchmark

LuxIT INLL exam B2 accuracy (judge selection)

Multilingual benchmarks compare model performance across languages. Scores are percentages. Higher is better.

Models and systems measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

83.3%
Mean
87.7%
Median
4.4%
Std dev
78.9%
10th percentile
87.7%
90th percentile
78.9%
Min
78.9%87.7%
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
GPT-5table: 5, column: B2, system: GPT-5· LuxIT (arXiv:2510.24434v4) data87.7%
GPT-5-minitable: 5, column: B2, system: GPT-5-mini· LuxIT (arXiv:2510.24434v4) data78.9%

Data credits: Julian Valline, Cedric Lothritz, Siwen Guo and Jordi Cabot. LuxIT: A Luxembourgish Instruction Tuning Dataset from Monolingual Seed Data. arXiv:2510.24434v4. CC BY 4.0 article numeric/protocol extract; restructured, printed values unchanged. Task data, private fine-tunes, exams and weights excluded. (licence)