Benchmark
KazBench Kazakh translation (chrF, dev)
Higher scores are better.
Benchmark sourceScores from KazBench Kazakh data docs.
- Models measured
- 6
- Scores recorded
- 6
- Sources
- 1
- IQ weight
- 1.12
Score distribution
- 77.5
- Mean
- 88.2
- Median
- 23.2
- Std dev
- 79.8
- 10th percentile
- 92.3
- 90th percentile
- 26.4
- Min
This benchmark has a weight of 1.12 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o minidev, version: 0.1.0· KazBench Kazakh data docs | 92.3 |
| 2 | Llama 4 Scoutdev, version: 0.1.0· KazBench Kazakh data docs | 92.1 |
| 3 | Gemini 2.5 Flashdev, version: 0.1.0· KazBench Kazakh data docs | 88.2 |
| 4 | Claude Haiku 3.5dev, version: 0.1.0· KazBench Kazakh data docs | 86.1 |
| 5 | Qwen2.5 72B Instructdev, version: 0.1.0· KazBench Kazakh data docs | 79.8 |
| 6 | Llama 3.1 8B Instantdev, version: 0.1.0· KazBench Kazakh data docs | 26.4 |