Benchmark
IdrockBench Uzbek core composite (chance-normalised; dtm 2.1, reasoning_uz 2.0, translation_uz 2.0, ifeval_uz 2.0, zarbulmasal 1.0)
Instruction following benchmarks measure how closely models follow instructions. Scores are index points out of 100. Higher is better.
- Models measured
- 12
- Scores recorded
- 12
- Sources
- 1
- IQ weight
- 0.75
Score distribution
- 31.5
- Mean
- 30.7
- Median
- 15.4
- Std dev
- 12.9
- 10th percentile
- 52
- 90th percentile
- 9.2
- Min
This benchmark has a weight of 0.75 for chat models, measured over 12 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Qwen3.6 27BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 52.3 |
| 2 | Gemma 4 31B ITQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 52 |
| 3 | Qwen3.5 27BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 48.5 |
| 4 | Qwen 3.8 27BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 45.7 |
| 5 | Gemma 4 26BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 42.2 |
| 6 | Qwen3.5 9BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 30.7 |
| 7 | gemma 4 E4BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 29.5 |
| 8 | Qwen3.5 4BQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 22.4 |
| 9 | Gemma 4 E2B ITQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 20 |
| 10 | Qwen3.5 2BQ8_0, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 13.2 |
| 11 | Nemotron 3.5 Lightning 30bQ4_K_M, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 12.9 |
| 12 | Qwen3.5 0.8BQ8_0, reasoning: no-think, organiser-run· IdrockBench Uzbek leaderboard data docs | 9.2 |