Skip to content

Benchmark

llminfo Elo (Rapidata votes): Physics – Blind

Scores are Elo ratings. Higher ratings are better.

Computed by llminfo from Rapidata's published CC BY 4.0 vote data. Bradley-Terry ratings on the conventional Elo scale, fitted per board so that the rated models average 1000. Each board has its own scale: a rating is comparable only with others on the same board, not across boards or with other Elo leaderboards. The ± figure is a 95% interval from the fit and understates the true uncertainty, since votes on the same prompt are not independent.

Models measured
22
Scores recorded
22
Sources
1
IQ weight
No weight published

Score distribution

1,030.2
Mean
1,034.8
Median
40.9
Std dev
978.6
10th percentile
1,079.2
90th percentile
935.9
Min
935.91,094.3
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Gemini Omni 1.1 Flash· llminfo Elo (computed from Rapidata's published votes) data1,094.3± 3.4
2Flux 3 Max· llminfo Elo (computed from Rapidata's published votes) data1,087.2± 7.6
3MiniMax H3· llminfo Elo (computed from Rapidata's published votes) data1,079.2± 3.4
4Gemini Omni Flash Preview· llminfo Elo (computed from Rapidata's published votes) data1,077.7± 3.4
5Dreamina Seedance 2.0· llminfo Elo (computed from Rapidata's published votes) data1,073.1± 3.4
6FLUX 3 Video· llminfo Elo (computed from Rapidata's published votes) data1,067.2± 3.4
7Wan 3.0· llminfo Elo (computed from Rapidata's published votes) data1,058.3± 3.3
8Dreamina Seedance 2.5· llminfo Elo (computed from Rapidata's published votes) data1,054.2± 3.3
9Grok Imagine Video 1.5· llminfo Elo (computed from Rapidata's published votes) data1,041.9± 3.3
10Grok Imagine Video· llminfo Elo (computed from Rapidata's published votes) data1,040.3± 3.3
11Kling V3 Pro· llminfo Elo (computed from Rapidata's published votes) data1,034.8± 3.3
12Veo 3.1· llminfo Elo (computed from Rapidata's published votes) data1,022.9± 3.3
13HappyHorse 1.0· llminfo Elo (computed from Rapidata's published votes) data1,022.4± 3.3
14Kling 2.6 Pro· llminfo Elo (computed from Rapidata's published votes) data1,021.6± 3.3
15Veo 3.1 Fast· llminfo Elo (computed from Rapidata's published votes) data1,011.4± 3.3
16Q3 Pro· llminfo Elo (computed from Rapidata's published votes) data1,007.6± 3.3
17Wan 2.7· llminfo Elo (computed from Rapidata's published votes) data997.6± 3.3
18Wan 2.6· llminfo Elo (computed from Rapidata's published votes) data995.5± 3.3
19PixVerse V5.6· llminfo Elo (computed from Rapidata's published votes) data991.9± 3.3
20Wan 2.5 Preview· llminfo Elo (computed from Rapidata's published votes) data978.6± 3.3
21Mischief 1· llminfo Elo (computed from Rapidata's published votes) data970.4± 7.6
22Seedance 1.5 Pro· llminfo Elo (computed from Rapidata's published votes) data935.9± 3.4

Data credits: Ratings computed by llminfo (Bradley-Terry) from human pairwise-vote data published by Rapidata on Hugging Face, CC BY 4.0 — not Rapidata's own ranking. SVG board prompts derive from yupp-ai/yupp-svg-20251204 (Yupp AI, CC BY 4.0); Physics board scenarios are from Physics-IQ (Motamed et al., Google DeepMind / INSAIT). (licence)