Benchmark
Vdebench
Scores are percentages. Higher is better.
Scores from Hugging Face Official Benchmarks data.
- Models measured
- 9
- Scores recorded
- 11
- Sources
- 1
- IQ weight
- 0.95
Score distribution
- 62%
- Mean
- 63.8%
- Median
- 12.8%
- Std dev
- 45.9%
- 10th percentile
- 76.7%
- 90th percentile
- 42.3%
- Min
This benchmark has a weight of 0.95 for image-generation models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Qwen Image 2.1· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 80.6% |
| 2 | FLUX.2 [klein] 4B· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 76.7% |
| 3 | Qwen Image Edit· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 75.7% |
| 4 | Longcat Image Edit· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 70.1% |
| 5 | Qwen Image Edit2511· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 65.6% |
| 6 | firered-image-edit-v1.1· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 63.8% |
| 7 | Qwen Image Edit2509· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 61.8% |
| 8 | Hidream O1 Image· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 51% |
| 9 | Step1X-Edit· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 48.2% |
| 10 | GLM-Image· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 45.9% |
| 11 | Flux Kontext Dev· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim | 42.3% |
Data credits: Hugging Face official benchmark leaderboards; licence varies by benchmark