Benchmark
OmniCapBench · Semantic · Subshot recall
Scores are percentages. Higher is better.
Benchmark sourceScores from BenchBoard docs.
- Models and systems measured
- 9
- Scores recorded
- 9
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 43.1%
- Mean
- 44.9%
- Median
- 9.6%
- Std dev
- 29.4%
- 10th percentile
- 53.1%
- 90th percentile
- 27.6%
- Min
Leaderboard
| # | Model or system | Score |
|---|---|---|
| 1 | Gemini 3.1 Pro PreviewOmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 53.3% |
| 2 | Qwen3.5 Omni PlusOmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 50.2% |
| 3 | MiMo V2.5OmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 44.9% |
| 4 | Qwen3.5 Omni FlashOmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 44.1% |
Not ranked
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| Gemini 2.5 ProOmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 53.1% |
| MiniCPM-o 2.6 (OmniCapBench label)OmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 27.6% |
| Qwen3 Omni Captioner (OmniCapBench label)OmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 34% |
| Qwen3 Omni Instruct (OmniCapBench label)OmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 29.4% |
| Seed2.0 (OmniCapBench label)OmniCapBench benchmark-owner run · 786 audio-video clips (12.8 hours) · structured MTSS captions · macro average across videos · bounded localized semantic judging on structurally aligned units · candidate reasoning effort, exact API snapshot and judge model not specified on public leaderboard· Reported by OmniCapBench authors / Tencent Hunyuan· via BenchBoard docs | 51.2% |