Skip to content

Benchmark

OpenLLM French IFEval-fr (normalized)

Instruction following benchmarks measure how closely models follow instructions. Higher scores are better.

Models measured
14
Scores recorded
14
Sources
1
IQ weight
0.38

Score distribution

0.14
Mean
0.146
Median
0.027
Std dev
0.095
10th percentile
0.173
90th percentile
0.0916
Min
0.09160.187
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.38 for chat models, measured over 14 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: OpenLLM French Leaderboard (le-leadboard), Mohamad Alhajar and Alexandre Lavallée; publisher-normalized public result files; results licence not stated (the Space's Apache-2.0 covers code)