Skip to content

Benchmark

VideoSimpleQA

Factuality benchmarks measure how often models get facts right. Scores are percentages.

Models measured
4
Scores recorded
4
Sources
1
IQ weight
No weight published

Score distribution

70.8%
Mean
71.4%
Median
3.5%
Std dev
67.7%
10th percentile
76.4%
90th percentile
67.7%
Min
67.7%76.4%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Doubao Seed 2.1 Pro· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim76.4%
2Doubao Seed 2.1 Turbo· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim71.4%
3Doubao Seed 1.8· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim67.8%
4Seed 2.0 Mini· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim67.7%

Data credits: Data by LLM Stats