Skip to content

Benchmark

Audio MultiChallenge · Instruction Following

Scores are percentages. Higher is better.

Models and systems measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

41.6%
Mean
48.5%
Median
6.9%
Std dev
34.7%
10th percentile
48.5%
90th percentile
34.7%
Min
34.7%48.5%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#Model or systemScore
1GPT Realtime 2OpenAI release chart · xhigh reasoning· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.48.5%

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
GPT-Realtime-1.5OpenAI release chart · reasoning setting unspecified· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.34.7%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.