Skip to content

Benchmark

AHELM: MuTox - EM

Scores are percentages.

Models measured
12
Scores recorded
359
Sources
1
IQ weight
No weight published

Score distribution

75.5%
Mean
77.9%
Median
15.6%
Std dev
53.4%
10th percentile
100%
90th percentile
33.3%
Min
33.3%100%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
151gemini-1.5-pro-002language: Arabic· AHELM (HELM Audio) data80%
152gemini-1.5-pro-002language: Swahili· AHELM (HELM Audio) data80%
153GPT-4o mini Audio Previewlanguage: Arabic· AHELM (HELM Audio) data80%
154Qwen2.5-Omni 7Blanguage: Arabic· AHELM (HELM Audio) data80%
155Gemini 2.5 Flash Preview 05-20 (no think)language: Polish· AHELM (HELM Audio) data79.9%
156Gemini 2.5 Flash Preview 05-20 (no think)language: Greek· AHELM (HELM Audio) data79.7%
157gemini-1.5-pro-002language: Greek· AHELM (HELM Audio) data79.7%
158Gemini 2.5 Flash Preview 05-20 (no think)· AHELM (HELM Audio) data79.7%
159Gemini 2.0 Flash Litelanguage: Hebrew· AHELM (HELM Audio) data79.3%
160Gemini 2.5 Pro Preview 05-06language: Hebrew· AHELM (HELM Audio) data79.3%
161Gemini 2.5 Pro Preview 05-06language: Slovak· AHELM (HELM Audio) data79.2%
162Qwen2.5-Omni 7Blanguage: Hungarian· AHELM (HELM Audio) data79%
163gemini-1.5-pro-001language: Estonian· AHELM (HELM Audio) data78.9%
164Gemini 2.5 Pro Preview 05-06language: Czech· AHELM (HELM Audio) data78.8%
165Gemini 2.0 Flashlanguage: German· AHELM (HELM Audio) data78.6%
166Gemini 2.0 Flash Experimentallanguage: German· AHELM (HELM Audio) data78.6%
167Gemini 2.0 Flash Litelanguage: German· AHELM (HELM Audio) data78.6%
168Gemini 2.5 Flash Preview 05-20 (no think)language: German· AHELM (HELM Audio) data78.6%
169Gemini 2.5 Pro Preview 05-06language: German· AHELM (HELM Audio) data78.6%
170gemini-1.5-pro-001language: German· AHELM (HELM Audio) data78.6%
171gemini-1.5-pro-002language: German· AHELM (HELM Audio) data78.6%
172GPT-4o mini Audio Previewlanguage: German· AHELM (HELM Audio) data78.6%
173GPT-4o mini Audio Previewlanguage: Vietnamese· AHELM (HELM Audio) data78.6%
174Gemini 2.5 Flash Preview 05-20 (no think)language: Bulgarian· AHELM (HELM Audio) data78.4%
175gemini-1.5-pro-002language: Bulgarian· AHELM (HELM Audio) data78.4%
176gemini-1.5-pro-001language: Greek· AHELM (HELM Audio) data78.4%
177Gemini 2.0 Flash Litelanguage: Danish· AHELM (HELM Audio) data78.4%
178Qwen2.5-Omni 7Blanguage: Danish· AHELM (HELM Audio) data78.4%
179gemini-1.5-pro-002language: Polish· AHELM (HELM Audio) data78.1%
180Gemini 2.0 Flash Litelanguage: Hungarian· AHELM (HELM Audio) data77.9%
181Gemini 2.0 Flash Litelanguage: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
182Gemini 2.0 Flash Litelanguage: Russian· AHELM (HELM Audio) data77.8%
183Gemini 2.5 Flash Preview 05-20 (no think)language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
184Gemini 2.5 Flash Preview 05-20 (no think)language: Russian· AHELM (HELM Audio) data77.8%
185Gemini 2.5 Pro Preview 05-06language: Danish· AHELM (HELM Audio) data77.8%
186Gemini 2.5 Pro Preview 05-06language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
187gemini-1.5-flash-001language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
188gemini-1.5-flash-002language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
189gemini-1.5-flash-002language: Russian· AHELM (HELM Audio) data77.8%
190gemini-1.5-pro-001language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
191gemini-1.5-pro-001language: Russian· AHELM (HELM Audio) data77.8%
192gemini-1.5-pro-002language: Danish· AHELM (HELM Audio) data77.8%
193gemini-1.5-pro-002language: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
194gemini-1.5-pro-002language: Russian· AHELM (HELM Audio) data77.8%
195GPT-4o Audio Previewlanguage: Russian· AHELM (HELM Audio) data77.8%
196GPT-4o mini Audio Previewlanguage: Russian· AHELM (HELM Audio) data77.8%
197Qwen2.5-Omni 7Blanguage: Mandarin_Chinese· AHELM (HELM Audio) data77.8%
198Qwen2.5-Omni 7Blanguage: Russian· AHELM (HELM Audio) data77.8%
199Gemini 2.5 Flash Preview 05-20 (no think)language: Hebrew· AHELM (HELM Audio) data77.3%
200gemini-1.5-pro-001· AHELM (HELM Audio) data77.1%

Showing 151–200 of 359 results.