Skip to content

Benchmark

FLEURS

Scores are percentages.

Models measured
8
Scores recorded
8
Sources
1
IQ weight
0.03

Score distribution

92.8%
Mean
93.6%
Median
2.8%
Std dev
90.4%
10th percentile
95%
90th percentile
86.4%
Min
86.4%95.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.03 for chat models, measured over 5 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen2.5-Omni 7B· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim95.9%
2Gemini 3.5 Transcribe· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim95%
3Gemini 3.5 Transcribe Live· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim94.5%
4gemini-1.0-pro· LLM Stats data93.6%
5Gemini 1.5 Pro· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim93.3%
6Gemma 4 12B It· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim93.1%
7Gemini 1.5 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim90.4%
8Gemini 1.5 Flash-8B· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim86.4%

Data credits: Data by LLM Stats