Skip to content

Alibaba · Chat

Qwen2 7B Instruct

Alibaba 🇨🇳ChatQwen family

Newer version: Qwen2.5 7B Instruct. We compared release dates and version names in our catalogue.

Open Source Qianwen 7B

llminfo IQ
93.0
Market median price
$0.054 blended / 1M
Max context
33K
Listings
5

Evidence and sources

International storefront (alibabacloud.com) is Singapore-incorporated; mainland operating entity 杭州阿里云智能科技有限公司 (Hangzhou).

🤗 Qwen/Qwen2-7B-Instructllminfo IQ 93.0, ranked among chat models. From 113 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 70.6, 95% interval 61–80. From 5 benchmark families across 2 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.How Coding IQ is computedReleased 4 Jun 2024Maker HQ: CN (source)
Sources: Alibaba Cloud Model Studio (DashScope) Multi-Region API, AIHubMix data docs, 302.ai data, Hugging FacePrimary data from Alibaba Cloud Model Studio (DashScope) Multi-Region API from AIHubMix: name from 302.ai: description from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 302aiPro/Qwen/Qwen2-7B-InstructSource: 302.ai data32K$0.05$0.05
 AihubmixQwen/Qwen2-7B-InstructSource: AIHubMix data docsNot published by the provider$0.08$0.08
 Fireworks AIfireworks_ai/accounts/fireworks/models/qwen2-7b-instructSource: LiteLLM data33K$0.20$0.20
 Novita AIqwen/qwen-2-7b-instructSource: GenAI Prices dataNot published by the provider$0.054$0.054

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Multilingual

General

MultiPL-ESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Coding

EvalplusSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Math

GSM8KSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
TheoremQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Reasoning

C-EvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MMLU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Human preference

MT-BenchSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Instruction following

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

FinBen60 related benchmarks · 60 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 54 more resultsHide 54 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
ECTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BertScore
ECTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, Rouge-1
EDTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BertScore
EDTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, Rouge-1
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, ACC
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, ACC
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, ACC
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FINER-ORD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, F1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, ACC
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, ACC
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1

Data credits: Data by LLM Stats · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.

Also known as: fireworks_ai/accounts/fireworks/models/qwen2-7b-instruct, pro/qwen/qwen2-7b-instruct, qwen/qwen-2-7b-instruct, qwen/qwen2-7b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works