Skip to content

Benchmark

Macedonian native-speaker relevance rating

Multilingual benchmarks compare model performance across languages. Higher scores are better.

Models and systems measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

4.1
Mean
4.3
Median
0.18
Std dev
3.9
10th percentile
4.3
90th percentile
3.9
Min
3.94.3
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
domestic-yak-instructsection: 6.3, measure: relevance· Macedonian Foundation Model (arXiv:2506.09560v1) data4.3
Llama 3.1 70Bsection: 6.3, measure: relevance· Macedonian Foundation Model (arXiv:2506.09560v1) data3.9

Data credits: Stefan Krsteski, Matea Tashkovska, Borjan Sazdov, Hristijan Gjoreski and Branislav Gerazov. Towards Open Foundation Language Model and Corpus for Macedonian, arXiv:2506.09560v1. CC BY 4.0 article numeric/protocol extract; restructured, printed values unchanged. No task, corpus, weight or raw survey rights asserted. (licence)