Skip to content

Benchmark

Omnicompass

Scores are percentages. Higher is better.

Models measured
19
Scores recorded
19
Sources
1
IQ weight
1.49

Score distribution

30%
Mean
28.5%
Median
5.2%
Std dev
25.5%
10th percentile
37.2%
90th percentile
23.6%
Min
23.6%43.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.49 for chat models, measured over 19 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Kimi K3.1 Pro· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim43.5%
2Kimi K3· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim39.6%
3Qwen3.5 397B A17B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim37.2%
4Qwen3 VL 235B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim34.5%
5Qwen3.5 122B-A10B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim33.5%
6GLM 5.3 Flash· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim30.8%
7Qwen 3.8 27B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim29.6%
8Qwen3.5 27B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim28.9%
9Qwen3.6 27B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim28.6%
10Qwen3.6 35B A3B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim28.5%
11DeepSeek V4.1 Flash 1017· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim28%
12Qwen3.5 35B A3B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim27.1%
13Qwen3.5 9B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim27%
14DeepSeek V4.1 Flash· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim26.5%
15MiniCPM-V 4.7 35B-A3B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim26.3%
16Qwen3 VL 8B Instruct· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim26.1%
17MiMo V2.5· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim25.5%
18Qwen3.5 4B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim24.3%
19qwen3-vl-30b· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim23.6%

Data credits: Hugging Face official benchmark leaderboards; licence varies by benchmark