Skip to content

Alibaba · Chat

Qwen2 72B Instruct

Alibaba 🇨🇳ChatQwen family

Newer version: Qwen2.5 72B Instruct. We compared release dates and version names in our catalogue.

llminfo IQ
107.3
Market median price
$0.90 blended / 1M
Max context
33K
Listings
5

Evidence and sources

International storefront (alibabacloud.com) is Singapore-incorporated; mainland operating entity 杭州阿里云智能科技有限公司 (Hangzhou).

🤗 Qwen/Qwen2-72B-Instructllminfo IQ 107.3, ranked among chat models. From 265 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 76.2, 95% interval 65–87. From 4 benchmark families across 2 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (34.3). Costs more per task than its benchmark results predict. From 2 benchmarks with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksReleased 28 May 2024Maker HQ: CN (source)
Sources: LMArena data, Together AI data, Hugging FacePrimary data from LMArena from Together AI: name from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

as stated by the model's providers
Text
Text

Listings

 AihubmixQwen/Qwen2-72B-InstructSource: AIHubMix data docsNot published by the provider$0.80$0.80
 OpenRouterqwen-2-72b-instructSource: GenAI Prices dataNot published by the provider$0.90$0.90
 Fireworks AIfireworks_ai/accounts/fireworks/models/qwen2-72b-instructSource: LiteLLM data33K$0.90$0.90
 Together AIQwen/Qwen2-72B-InstructSource: Together AI data33K$0.90$0.90

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score

Knowledge

HELM59 related benchmarks · 59 results
Show 53 more resultsHide 53 results
MMLU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Human preference

Arena ELO26 related benchmarks · 26 results
WildBench26 related benchmarks · 26 results
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
gpt4t_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.task_macro.K: -1, gpt-4-turbo-2024-04-09
Show 20 more resultsHide 20 results
haiku_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Creative Tasks.K: -1, claude-3-haiku-20240307
haiku_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Information/Advice seeking.K=-1, claude-3-haiku-20240307
haiku_reward.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.K: -1, claude-3-haiku-20240307
haiku_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Planning & Reasoning.K=-1, claude-3-haiku-20240307
haiku_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.task_macro.K: -1, claude-3-haiku-20240307
llama_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Creative Tasks.K: -1, Llama-2-70b-chat-hf
llama_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Information/Advice seeking.K=-1, Llama-2-70b-chat-hf
llama_reward.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.K: -1, Llama-2-70b-chat-hf
llama_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Planning & Reasoning.K=-1, Llama-2-70b-chat-hf
llama_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.task_macro.K: -1, Llama-2-70b-chat-hf
mixture_of_rewards.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
task_macro_reward.K=-1
Source: WildBench direct data
allenai/WildBench, task_macro_reward.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro

Multilingual

Instruction following

Math

GSM8KSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
TheoremQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
WildBench5 related benchmarks · 5 results
WB_score.Math & Data Analysis
Source: WildBench direct data
allenai/WildBench, WB_score.Math & Data Analysis
gpt4t_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Math & Data Analysis.K=-1, claude-3-haiku-20240307
llama_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Math & Data Analysis.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

Reasoning

ARC-CSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
BBHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
C-EvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HellaSwagSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Coding

EvalplusSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
WildBench5 related benchmarks · 5 results
WB_score.Coding & Debugging
Source: WildBench direct data
allenai/WildBench, WB_score.Coding & Debugging
gpt4t_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Coding & Debugging.K=-1, claude-3-haiku-20240307
llama_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Coding & Debugging.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

Long context

General

MultiPL-ESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Agentic

Factuality

Speech

Other

CMMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Data credits: Data by LLM Stats · LMArena, CC BY 4.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · NVIDIA RULER, Hsieh et al. Official README numeric table; no separate results licence asserted. · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · WildBench, Allen Institute for AI

Also known as: fireworks_ai/accounts/fireworks/models/qwen2-72b-instruct, qwen-2-72b-instruct, qwen/qwen-2-72b-instruct, qwen/qwen2-72b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works