Skip to content

Benchmark

OpenLLM French MMMLU-fr (normalized)

Multilingual benchmarks compare model performance across languages. Higher scores are better.

Models measured
14
Scores recorded
14
Sources
1
IQ weight
1.24

Score distribution

0.568
Mean
0.566
Median
0.098
Std dev
0.42
10th percentile
0.69
90th percentile
0.413
Min
0.4130.712
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.24 for chat models, measured over 14 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: OpenLLM French Leaderboard (le-leadboard), Mohamad Alhajar and Alexandre Lavallée; publisher-normalized public result files; results licence not stated (the Space's Apache-2.0 covers code)