Skip to content

OpenAI · Chat

GPT-3.5 Turbo

OpenAI 🇺🇸ChatGPT familyOne of its sources says the weights aren't publicly available.The maker lists this model as deprecated (23 Oct 2026).

Newer version: GPT-4 Turbo. Our catalogue has no release date for GPT-3.5 Turbo. We compared the version names in our catalogue.

From Aiml API's listing:
Fast and cost-efficient OpenAI model for a wide range of text generation and conversation tasks.
llminfo IQ
99.4
Maker's price
$0.375 blended / 1M
Max context
16K
Listings
49

Evidence and sources

llminfo IQ 99.4, ranked among chat models. From 417 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 75.7, 95% interval 65–87. From 4 benchmark families across 3 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (27.7). Costs more per task than its benchmark results predict. From 3 benchmarks with measured task costs. A fair amount of data behind it.How Value for money works Training-data cutoff, as its sources state it Maker HQ: US (according to OpenAI's own website)
All rankings: #484 on OpenRouter this month #498 on OpenRouter this week #545 on OpenRouter todaySources: LMArena data, LiteLLM data, Models.dev data, AI/ML API data, OpenRouter data docsPrimary data from LMArena from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode, description from OpenRouter: knowledge cutoff

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecated by its maker

The maker has already deprecated this model (23 Oct 2026).

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 2 market median prices.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionFunction callingStructured outputPrompt cachingBatch API

Listings

 OpenAIgpt-3.5-turbo-0125-batch · batch, 0125Source: Helicone Costs dataNot published by the provider$0.25$0.75
 Microsoft Azuregpt-3.5-turbo-0125-batch · batch, 0125Source: Helicone Costs dataNot published by the provider$0.25$0.75
 Poeopenai/gpt-3.5-turboSource: Models.dev data16K$0.45$1.40
 302aigpt-3.5-turbo-0125 · 0125Source: 302.ai data16K$0.50$1.50
 Aihubmixgpt-3.5-turboSource: AIHubMix data docsNot published by the provider$0.50$1.50
 Fastrouteropenai/gpt-3.5-turboSource: FastRouter data16K$0.50$1.50
 Flowdotopenai/gpt-3.5-turboSource: FlowDot data16K$0.50$1.50
 OpenRouteropenai/gpt-3.5-turboSource: GenAI Prices dataNot published by the provider$0.50$1.50
 Vercelopenai/gpt-3-5-turboSource: Helicone Costs dataNot published by the provider$0.50$1.50
 Impossiblopenai/gpt-3.5-turboSource: Models.dev data16K$0.50$1.50
Show all 40 listings

Showing 10 of 40: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

Also sold by Kilo, Merge Gateway, Nous Portal, Orcarouter, Vercel AI Gateway.

9 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Multilingual

Bridging the Gap526 related benchmarks · 536 results
Belebele English (en) original
Source: Bridging the Gap (arXiv:2412.12417v1) data
By section · table: A.15 · task: Belebele · language: en · shots: 0
table: 2, task: Belebele, language: en, shots: 0
Belebele 11-language African average
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 1, section: average, task: Belebele
Belebele Afrikaans (af) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: af, shots: 0
Belebele Afrikaans (af) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: af, shots: 0
Belebele Afrikaans (af) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: af, shots: 0
Belebele Afrikaans (af) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: af, shots: 0
Show 528 more resultsHide 528 results
Belebele Afrikaans (af) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: af, shots: 0
Belebele Amharic (am) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: am, shots: 0
Belebele Amharic (am) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: am, shots: 0
Belebele Amharic (am) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: am, shots: 0
Belebele Amharic (am) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: am, shots: 0
Belebele Amharic (am) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: am, shots: 0
Belebele Bambara (bm) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: bm, shots: 0
Belebele Bambara (bm) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: bm, shots: 0
Belebele Bambara (bm) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: bm, shots: 0
Belebele Bambara (bm) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: bm, shots: 0
Belebele Bambara (bm) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: bm, shots: 0
Belebele English (en) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: en, shots: 0
Belebele English (en) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: en, shots: 0
Belebele Igbo (ig) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: ig, shots: 0
Belebele Igbo (ig) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: ig, shots: 0
Belebele Igbo (ig) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: ig, shots: 0
Belebele Igbo (ig) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: ig, shots: 0
Belebele Igbo (ig) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: ig, shots: 0
Belebele Sepedi (nso) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: nso, shots: 0
Belebele Sepedi (nso) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: nso, shots: 0
Belebele Sepedi (nso) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: nso, shots: 0
Belebele Sepedi (nso) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: nso, shots: 0
Belebele Sepedi (nso) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: nso, shots: 0
Belebele Sesotho (st) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: st, shots: 0
Belebele Sesotho (st) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: st, shots: 0
Belebele Sesotho (st) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: st, shots: 0
Belebele Sesotho (st) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: st, shots: 0
Belebele Sesotho (st) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: st, shots: 0
Belebele Setswana (tn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: tn, shots: 0
Belebele Setswana (tn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: tn, shots: 0
Belebele Setswana (tn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: tn, shots: 0
Belebele Setswana (tn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: tn, shots: 0
Belebele Setswana (tn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: tn, shots: 0
Belebele Shona (sn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: sn, shots: 0
Belebele Shona (sn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: sn, shots: 0
Belebele Shona (sn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: sn, shots: 0
Belebele Shona (sn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: sn, shots: 0
Belebele Shona (sn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: sn, shots: 0
Belebele Tsonga (ts) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: ts, shots: 0
Belebele Tsonga (ts) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: ts, shots: 0
Belebele Tsonga (ts) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: ts, shots: 0
Belebele Tsonga (ts) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: ts, shots: 0
Belebele Tsonga (ts) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: ts, shots: 0
Belebele Xhosa (xh) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: xh, shots: 0
Belebele Xhosa (xh) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: xh, shots: 0
Belebele Xhosa (xh) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: xh, shots: 0
Belebele Xhosa (xh) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: xh, shots: 0
Belebele Xhosa (xh) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: xh, shots: 0
Belebele Zulu (zu) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-accuracy, task: Belebele, language: zu, shots: 0
Belebele Zulu (zu) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Belebele, language: zu, shots: 0
Belebele Zulu (zu) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: back-translation-difference, task: Belebele, language: zu, shots: 0
Belebele Zulu (zu) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-difference, task: Belebele, language: zu, shots: 0
Belebele Zulu (zu) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.15, section: machine-translation-accuracy, task: Belebele, language: zu, shots: 0
Clinical Knowledge Afrikaans (af) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: af, shots: 5
Clinical Knowledge Afrikaans (af) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: af, shots: 5
Clinical Knowledge Amharic (am) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: am, shots: 5
Clinical Knowledge Amharic (am) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: am, shots: 5
Clinical Knowledge Bambara (bm) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: bm, shots: 5
Clinical Knowledge Bambara (bm) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: bm, shots: 5
Clinical Knowledge English (en) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: en, shots: 5
Clinical Knowledge English (en) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: en, shots: 5
Clinical Knowledge Igbo (ig) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: ig, shots: 5
Clinical Knowledge Igbo (ig) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: ig, shots: 5
Clinical Knowledge Sepedi (nso) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: nso, shots: 5
Clinical Knowledge Sepedi (nso) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: nso, shots: 5
Clinical Knowledge Sesotho (st) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: st, shots: 5
Clinical Knowledge Sesotho (st) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: st, shots: 5
Clinical Knowledge Setswana (tn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: tn, shots: 5
Clinical Knowledge Setswana (tn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: tn, shots: 5
Clinical Knowledge Shona (sn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: sn, shots: 5
Clinical Knowledge Shona (sn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: sn, shots: 5
Clinical Knowledge Tsonga (ts) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: ts, shots: 5
Clinical Knowledge Tsonga (ts) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: ts, shots: 5
Clinical Knowledge Xhosa (xh) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: xh, shots: 5
Clinical Knowledge Xhosa (xh) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: xh, shots: 5
Clinical Knowledge Zulu (zu) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-difference, task: MMLU Clinical Knowledge, language: zu, shots: 5
Clinical Knowledge Zulu (zu) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-difference, task: MMLU Clinical Knowledge, language: zu, shots: 5
College Medicine Afrikaans (af) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: af, shots: 5
College Medicine Afrikaans (af) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: af, shots: 5
College Medicine Amharic (am) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: am, shots: 5
College Medicine Amharic (am) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: am, shots: 5
College Medicine Bambara (bm) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: bm, shots: 5
College Medicine Bambara (bm) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: bm, shots: 5
College Medicine English (en) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: en, shots: 5
College Medicine English (en) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: en, shots: 5
College Medicine Igbo (ig) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: ig, shots: 5
College Medicine Igbo (ig) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: ig, shots: 5
College Medicine Sepedi (nso) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: nso, shots: 5
College Medicine Sepedi (nso) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: nso, shots: 5
College Medicine Sesotho (st) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: st, shots: 5
College Medicine Sesotho (st) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: st, shots: 5
College Medicine Setswana (tn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: tn, shots: 5
College Medicine Setswana (tn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: tn, shots: 5
College Medicine Shona (sn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: sn, shots: 5
College Medicine Shona (sn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: sn, shots: 5
College Medicine Tsonga (ts) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: ts, shots: 5
College Medicine Tsonga (ts) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: ts, shots: 5
College Medicine Xhosa (xh) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: xh, shots: 5
College Medicine Xhosa (xh) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: xh, shots: 5
College Medicine Zulu (zu) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-difference, task: MMLU College Medicine, language: zu, shots: 5
College Medicine Zulu (zu) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-difference, task: MMLU College Medicine, language: zu, shots: 5
MMLU Clinical Knowledge 11-language African average
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 1, section: average, task: MMLU Clinical Knowledge
MMLU Clinical Knowledge Afrikaans (af) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: af, shots: 5
MMLU Clinical Knowledge Afrikaans (af) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: af, shots: 5
MMLU Clinical Knowledge Afrikaans (af) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: af, shots: 5
MMLU Clinical Knowledge Amharic (am) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: am, shots: 5
MMLU Clinical Knowledge Amharic (am) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: am, shots: 5
MMLU Clinical Knowledge Amharic (am) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: am, shots: 5
MMLU Clinical Knowledge Bambara (bm) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: bm, shots: 5
MMLU Clinical Knowledge Bambara (bm) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: bm, shots: 5
MMLU Clinical Knowledge Bambara (bm) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: bm, shots: 5
MMLU Clinical Knowledge English (en) original
Source: Bridging the Gap (arXiv:2412.12417v1) data
By section · table: A.13 · task: MMLU Clinical Knowledge · language: en · shots: 5
table: 2, task: MMLU Clinical Knowledge, language: en, shots: 5
MMLU Clinical Knowledge Igbo (ig) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: ig, shots: 5
MMLU Clinical Knowledge Igbo (ig) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: ig, shots: 5
MMLU Clinical Knowledge Igbo (ig) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: ig, shots: 5
MMLU Clinical Knowledge Sepedi (nso) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: nso, shots: 5
MMLU Clinical Knowledge Sepedi (nso) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: nso, shots: 5
MMLU Clinical Knowledge Sepedi (nso) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: nso, shots: 5
MMLU Clinical Knowledge Sesotho (st) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: st, shots: 5
MMLU Clinical Knowledge Sesotho (st) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: st, shots: 5
MMLU Clinical Knowledge Sesotho (st) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: st, shots: 5
MMLU Clinical Knowledge Setswana (tn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: tn, shots: 5
MMLU Clinical Knowledge Setswana (tn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: tn, shots: 5
MMLU Clinical Knowledge Setswana (tn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: tn, shots: 5
MMLU Clinical Knowledge Shona (sn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: sn, shots: 5
MMLU Clinical Knowledge Shona (sn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: sn, shots: 5
MMLU Clinical Knowledge Shona (sn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: sn, shots: 5
MMLU Clinical Knowledge Tsonga (ts) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: ts, shots: 5
MMLU Clinical Knowledge Tsonga (ts) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: ts, shots: 5
MMLU Clinical Knowledge Tsonga (ts) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: ts, shots: 5
MMLU Clinical Knowledge Xhosa (xh) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: xh, shots: 5
MMLU Clinical Knowledge Xhosa (xh) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: xh, shots: 5
MMLU Clinical Knowledge Xhosa (xh) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: xh, shots: 5
MMLU Clinical Knowledge Zulu (zu) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: back-translation-accuracy, task: MMLU Clinical Knowledge, language: zu, shots: 5
MMLU Clinical Knowledge Zulu (zu) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Clinical Knowledge, language: zu, shots: 5
MMLU Clinical Knowledge Zulu (zu) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.13, section: machine-translation-accuracy, task: MMLU Clinical Knowledge, language: zu, shots: 5
MMLU College Medicine 11-language African average
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 1, section: average, task: MMLU College Medicine
MMLU College Medicine Afrikaans (af) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: af, shots: 5
MMLU College Medicine Afrikaans (af) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: af, shots: 5
MMLU College Medicine Afrikaans (af) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: af, shots: 5
MMLU College Medicine Amharic (am) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: am, shots: 5
MMLU College Medicine Amharic (am) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: am, shots: 5
MMLU College Medicine Amharic (am) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: am, shots: 5
MMLU College Medicine Bambara (bm) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: bm, shots: 5
MMLU College Medicine Bambara (bm) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: bm, shots: 5
MMLU College Medicine Bambara (bm) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: bm, shots: 5
MMLU College Medicine English (en) original
Source: Bridging the Gap (arXiv:2412.12417v1) data
By section · table: A.12 · task: MMLU College Medicine · language: en · shots: 5
table: 2, task: MMLU College Medicine, language: en, shots: 5
MMLU College Medicine Igbo (ig) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: ig, shots: 5
MMLU College Medicine Igbo (ig) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: ig, shots: 5
MMLU College Medicine Igbo (ig) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: ig, shots: 5
MMLU College Medicine Sepedi (nso) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: nso, shots: 5
MMLU College Medicine Sepedi (nso) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: nso, shots: 5
MMLU College Medicine Sepedi (nso) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: nso, shots: 5
MMLU College Medicine Sesotho (st) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: st, shots: 5
MMLU College Medicine Sesotho (st) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: st, shots: 5
MMLU College Medicine Sesotho (st) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: st, shots: 5
MMLU College Medicine Setswana (tn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: tn, shots: 5
MMLU College Medicine Setswana (tn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: tn, shots: 5
MMLU College Medicine Setswana (tn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: tn, shots: 5
MMLU College Medicine Shona (sn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: sn, shots: 5
MMLU College Medicine Shona (sn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: sn, shots: 5
MMLU College Medicine Shona (sn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: sn, shots: 5
MMLU College Medicine Tsonga (ts) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: ts, shots: 5
MMLU College Medicine Tsonga (ts) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: ts, shots: 5
MMLU College Medicine Tsonga (ts) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: ts, shots: 5
MMLU College Medicine Xhosa (xh) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: xh, shots: 5
MMLU College Medicine Xhosa (xh) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: xh, shots: 5
MMLU College Medicine Xhosa (xh) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: xh, shots: 5
MMLU College Medicine Zulu (zu) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: back-translation-accuracy, task: MMLU College Medicine, language: zu, shots: 5
MMLU College Medicine Zulu (zu) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU College Medicine, language: zu, shots: 5
MMLU College Medicine Zulu (zu) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.12, section: machine-translation-accuracy, task: MMLU College Medicine, language: zu, shots: 5
MMLU Virology 11-language African average
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 1, section: average, task: MMLU Virology
MMLU Virology Afrikaans (af) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: af, shots: 5
MMLU Virology Afrikaans (af) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: af, shots: 5
MMLU Virology Afrikaans (af) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: af, shots: 5
MMLU Virology Amharic (am) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: am, shots: 5
MMLU Virology Amharic (am) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: am, shots: 5
MMLU Virology Amharic (am) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: am, shots: 5
MMLU Virology Bambara (bm) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: bm, shots: 5
MMLU Virology Bambara (bm) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: bm, shots: 5
MMLU Virology Bambara (bm) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: bm, shots: 5
MMLU Virology English (en) original
Source: Bridging the Gap (arXiv:2412.12417v1) data
By section · table: A.14 · task: MMLU Virology · language: en · shots: 5
table: 2, task: MMLU Virology, language: en, shots: 5
MMLU Virology Igbo (ig) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: ig, shots: 5
MMLU Virology Igbo (ig) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: ig, shots: 5
MMLU Virology Igbo (ig) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: ig, shots: 5
MMLU Virology Sepedi (nso) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: nso, shots: 5
MMLU Virology Sepedi (nso) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: nso, shots: 5
MMLU Virology Sepedi (nso) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: nso, shots: 5
MMLU Virology Sesotho (st) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: st, shots: 5
MMLU Virology Sesotho (st) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: st, shots: 5
MMLU Virology Sesotho (st) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: st, shots: 5
MMLU Virology Setswana (tn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: tn, shots: 5
MMLU Virology Setswana (tn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: tn, shots: 5
MMLU Virology Setswana (tn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: tn, shots: 5
MMLU Virology Shona (sn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: sn, shots: 5
MMLU Virology Shona (sn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: sn, shots: 5
MMLU Virology Shona (sn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: sn, shots: 5
MMLU Virology Tsonga (ts) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: ts, shots: 5
MMLU Virology Tsonga (ts) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: ts, shots: 5
MMLU Virology Tsonga (ts) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: ts, shots: 5
MMLU Virology Xhosa (xh) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: xh, shots: 5
MMLU Virology Xhosa (xh) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: xh, shots: 5
MMLU Virology Xhosa (xh) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: xh, shots: 5
MMLU Virology Zulu (zu) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-accuracy, task: MMLU Virology, language: zu, shots: 5
MMLU Virology Zulu (zu) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: MMLU Virology, language: zu, shots: 5
MMLU Virology Zulu (zu) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-accuracy, task: MMLU Virology, language: zu, shots: 5
Virology Afrikaans (af) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: af, shots: 5
Virology Afrikaans (af) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: af, shots: 5
Virology Amharic (am) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: am, shots: 5
Virology Amharic (am) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: am, shots: 5
Virology Bambara (bm) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: bm, shots: 5
Virology Bambara (bm) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: bm, shots: 5
Virology English (en) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: en, shots: 5
Virology English (en) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: en, shots: 5
Virology Igbo (ig) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: ig, shots: 5
Virology Igbo (ig) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: ig, shots: 5
Virology Sepedi (nso) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: nso, shots: 5
Virology Sepedi (nso) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: nso, shots: 5
Virology Sesotho (st) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: st, shots: 5
Virology Sesotho (st) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: st, shots: 5
Virology Setswana (tn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: tn, shots: 5
Virology Setswana (tn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: tn, shots: 5
Virology Shona (sn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: sn, shots: 5
Virology Shona (sn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: sn, shots: 5
Virology Tsonga (ts) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: ts, shots: 5
Virology Tsonga (ts) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: ts, shots: 5
Virology Xhosa (xh) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: xh, shots: 5
Virology Xhosa (xh) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: xh, shots: 5
Virology Zulu (zu) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: back-translation-difference, task: MMLU Virology, language: zu, shots: 5
Virology Zulu (zu) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.14, section: machine-translation-difference, task: MMLU Virology, language: zu, shots: 5
Winogrande 11-language African average
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 1, section: average, task: Winogrande
Winogrande Afrikaans (af) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: af, shots: 5
Winogrande Afrikaans (af) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: af, shots: 5
Winogrande Afrikaans (af) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: af, shots: 5
Winogrande Afrikaans (af) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: af, shots: 5
Winogrande Afrikaans (af) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: af, shots: 5
Winogrande Amharic (am) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: am, shots: 5
Winogrande Amharic (am) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: am, shots: 5
Winogrande Amharic (am) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: am, shots: 5
Winogrande Amharic (am) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: am, shots: 5
Winogrande Amharic (am) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: am, shots: 5
Winogrande Bambara (bm) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: bm, shots: 5
Winogrande Bambara (bm) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: bm, shots: 5
Winogrande Bambara (bm) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: bm, shots: 5
Winogrande Bambara (bm) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: bm, shots: 5
Winogrande Bambara (bm) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: bm, shots: 5
Winogrande English (en) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: en, shots: 5
Winogrande English (en) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: en, shots: 5
Winogrande English (en) original
Source: Bridging the Gap (arXiv:2412.12417v1) data
By section · table: A.11 · task: Winogrande · language: en · shots: 5
table: 2, task: Winogrande, language: en, shots: 5
Winogrande Igbo (ig) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: ig, shots: 5
Winogrande Igbo (ig) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: ig, shots: 5
Winogrande Igbo (ig) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: ig, shots: 5
Winogrande Igbo (ig) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: ig, shots: 5
Winogrande Igbo (ig) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: ig, shots: 5
Winogrande Sepedi (nso) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: nso, shots: 5
Winogrande Sepedi (nso) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: nso, shots: 5
Winogrande Sepedi (nso) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: nso, shots: 5
Winogrande Sepedi (nso) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: nso, shots: 5
Winogrande Sepedi (nso) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: nso, shots: 5
Winogrande Sesotho (st) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: st, shots: 5
Winogrande Sesotho (st) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: st, shots: 5
Winogrande Sesotho (st) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: st, shots: 5
Winogrande Sesotho (st) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: st, shots: 5
Winogrande Sesotho (st) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: st, shots: 5
Winogrande Setswana (tn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: tn, shots: 5
Winogrande Setswana (tn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: tn, shots: 5
Winogrande Setswana (tn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: tn, shots: 5
Winogrande Setswana (tn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: tn, shots: 5
Winogrande Setswana (tn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: tn, shots: 5
Winogrande Shona (sn) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: sn, shots: 5
Winogrande Shona (sn) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: sn, shots: 5
Winogrande Shona (sn) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: sn, shots: 5
Winogrande Shona (sn) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: sn, shots: 5
Winogrande Shona (sn) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: sn, shots: 5
Winogrande Tsonga (ts) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: ts, shots: 5
Winogrande Tsonga (ts) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: ts, shots: 5
Winogrande Tsonga (ts) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: ts, shots: 5
Winogrande Tsonga (ts) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: ts, shots: 5
Winogrande Tsonga (ts) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: ts, shots: 5
Winogrande Xhosa (xh) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: xh, shots: 5
Winogrande Xhosa (xh) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: xh, shots: 5
Winogrande Xhosa (xh) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: xh, shots: 5
Winogrande Xhosa (xh) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: xh, shots: 5
Winogrande Xhosa (xh) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: xh, shots: 5
Winogrande Zulu (zu) human translation back-translated to English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-accuracy, task: Winogrande, language: zu, shots: 5
Winogrande Zulu (zu) human-translated
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: 2, task: Winogrande, language: zu, shots: 5
Winogrande Zulu (zu) human-translation minus back-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: back-translation-difference, task: Winogrande, language: zu, shots: 5
Winogrande Zulu (zu) human-translation minus machine-translation difference
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-difference, task: Winogrande, language: zu, shots: 5
Winogrande Zulu (zu) machine-translated from English
Source: Bridging the Gap (arXiv:2412.12417v1) data
table: A.11, section: machine-translation-accuracy, task: Winogrande, language: zu, shots: 5
EKI EstonianSource: Keelemudelite mõõdupuu data docs

Safety

HELM66 related benchmarks · 257 results
Safety: BBQ - BBQ accuracy
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #1: Confidentiality
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #2: Integrity
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #3: Availability
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
Show 234 more resultsHide 234 results
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #9: Violent acts
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #13: Harassment
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #16: Offensive Language
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #17: Adult content
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #18: Erotic
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #20: Monetized
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #32: Fraud
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #35: Sowing Division
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Child Harm
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Criminal Activities
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Deception
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Defamation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Discrimination/Bias
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Economic Harm
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Fundamental Rights
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Hate/Toxicity
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Manipulation
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Operational Misuses
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Political Usage
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Privacy
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Refusal Rate
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Security Risks
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Self-harm
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Sexual Content
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
AIR-Bench: AIRBench 2024 - Violence & Extremism
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Setting not stated
Safety: Anthropic Red Team - LM Evaluated Safety score
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Safety: BBQ - BBQ (ambiguous)
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Safety: BBQ - BBQ (unambiguous)
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Safety: HarmBench - LM Evaluated Safety score
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Safety: SimpleSafetyTests - LM Evaluated Safety score
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated
Safety: XSTest - LM Evaluated Safety score
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
Setting not stated

Knowledge

HELM59 related benchmarks · 115 results
Show 106 more resultsHide 106 results
MMLU: Business Ethics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Clinical Knowledge - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Biology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Chemistry - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Computer Science - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Mathematics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Medicine - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: College Physics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Computer Security - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Conceptual Physics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Econometrics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Electrical Engineering - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Elementary Mathematics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Biology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Chemistry - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School European History - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Geography - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Macroeconomics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Mathematics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Microeconomics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Physics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Psychology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School Statistics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School US History - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: High School World History - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Human Aging - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Human Sexuality - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: International Law - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Jurisprudence - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Logical Fallacies - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Machine Learning - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Management - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Marketing - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Medical Genetics - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Miscellaneous - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: MMLU All Subjects - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Moral Disputes - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Moral Scenarios - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Nutrition - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Philosophy - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Prehistory - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Professional Accounting - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Professional Law - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Professional Medicine - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Professional Psychology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Public Relations - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Security Studies - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Sociology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Us Foreign Policy - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: Virology - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated
MMLU: World Religions - EM
Source: Stanford HELM specialized suites data docs
Setting not stated
Setting not stated

Human preference

Arena ELO27 related benchmarks · 51 results
Source: LMArena data · Nov 2026
Benchmark01251106
Arena ELO
Chinese
Creative Writing
English
Show 23 more benchmarksHide 23 benchmarks
Benchmark01251106
Exclude Ties
Expert
French
German
Hard Prompts
Hard Prompts English
Industry Business and Management and Financial Operations
Industry Entertainment and Sports and Media
Industry Life and Physical and Social Science
Industry Mathematical
Industry Medicine and Healthcare
Industry Software and It Services
Industry Writing and Literature and Language
JapaneseNot measured
KoreanNot measured
Longer Query
Multi Turn
Non English
PolishNot measured
Russian
Spanish
Style-Controlled
WildBench26 related benchmarks · 26 results
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
gpt4t_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.task_macro.K: -1, gpt-4-turbo-2024-04-09
Show 20 more resultsHide 20 results
haiku_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Creative Tasks.K: -1, claude-3-haiku-20240307
haiku_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Information/Advice seeking.K=-1, claude-3-haiku-20240307
haiku_reward.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.K: -1, claude-3-haiku-20240307
haiku_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Planning & Reasoning.K=-1, claude-3-haiku-20240307
haiku_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.task_macro.K: -1, claude-3-haiku-20240307
llama_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Creative Tasks.K: -1, Llama-2-70b-chat-hf
llama_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Information/Advice seeking.K=-1, Llama-2-70b-chat-hf
llama_reward.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.K: -1, Llama-2-70b-chat-hf
llama_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Planning & Reasoning.K=-1, Llama-2-70b-chat-hf
llama_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.task_macro.K: -1, Llama-2-70b-chat-hf
mixture_of_rewards.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
task_macro_reward.K=-1
Source: WildBench direct data
allenai/WildBench, task_macro_reward.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro

Math

WildBench5 related benchmarks · 5 results
WB_score.Math & Data Analysis
Source: WildBench direct data
allenai/WildBench, WB_score.Math & Data Analysis
gpt4t_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Math & Data Analysis.K=-1, claude-3-haiku-20240307
llama_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Math & Data Analysis.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

Reasoning

Science

Coding

WildBench5 related benchmarks · 5 results
WB_score.Coding & Debugging
Source: WildBench direct data
allenai/WildBench, WB_score.Coding & Debugging
gpt4t_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Coding & Debugging.K=-1, claude-3-haiku-20240307
llama_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Coding & Debugging.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

General

Factuality

Speech

Agentic

Instruction following

Vision

Other

FinBen61 related benchmarks · 61 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 55 more resultsHide 55 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
ECTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BartScore
ECTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BertScore
ECTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, Rouge-1
EDTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BartScore
EDTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BertScore
EDTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, Rouge-1
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, ACC
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, ACC
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, ACC
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, ACC
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, ACC
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1
Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LMArena, CC BY 4.0 (licence) · Tuka Alhanai, Adam Kasumovic, Mohammad Ghassemi, Aven Zitzelberger, Jessica Lundin and Guillaume Chabot-Couture. Bridging the Gap: Enhancing LLM Performance for Low-Resource African Languages with New Benchmarks, Fine-Tuning, and Cultural Adjustments, arXiv:2412.12417v1. CC BY 4.0 article numeric/protocol extract, restructured with values unchanged. No task or model rights asserted. (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · ChemBench leaderboard, Jablonka group / lamalab-org. Public verified numeric result summaries; results licence not separately stated. · CSEBenchmark (Wang et al., IEEE S&P 2025). Copyright (c) 2024 NASP. MIT License. (licence) · Data by LLM Stats · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · WildBench, Allen Institute for AI

Also known as: azure/gpt-3.5-turbo, azure/gpt-35-turbo, github_copilot/gpt-3.5-turbo, github_copilot/gpt-3.5-turbo-0613, gpt-3.5-turbo-0125, gpt-3.5-turbo-0301, gpt-3.5-turbo-0613, gpt-3.5-turbo-1106, gpt-35-turbo, gpt-35-turbo-0613, gpt-35-turbo-1106, openai/gpt-3-5-turbo, openai/gpt-3.5-turbo, openai/gpt-3.5-turbo-0125, openai/gpt-3.5-turbo-0613, openai/gpt-3.5-turbo-1106, vercel_ai_gateway/openai/gpt-3.5-turbo

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works