Skip to content

Alibaba · Chat

Qwen2.5 7B Instruct

Alibaba 🇨🇳ChatQwen familyOpen weights. One of its sources says the weights are publicly available.

Open Source Qianwen 7B

llminfo IQ
98.8
Market median price
$0.055 blended / 1M
Max context
33K
Listings
16

Evidence and sources

International storefront (alibabacloud.com) is Singapore-incorporated; mainland operating entity 杭州阿里云智能科技有限公司 (Hangzhou).

🤗 Qwen/Qwen2.5-7B-Instructllminfo IQ 98.8, ranked among chat models. From 248 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 73.2, 95% interval 64–82. From 6 benchmark families across 3 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.How Coding IQ is computedGood value (54.3). Cheaper per task than its benchmark results predict. From 1 benchmark with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksReleased 16 Sep 2024Maker HQ: CN (source)
All rankings: #311 on OpenRouter this monthSources: SiliconFlow data, Models.dev data, Simplismart Pricing, 302.ai data, Hugging FacePrimary data from SiliconFlow from Models.dev: weights availability from Simplismart Pricing: primary mode from 302.ai: description from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Open weights available

The weights are public. 2 of the 6 peers that say either way have open weights.

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Function callingStructured output

Listings

 Eden AIInference by DeepInfradeepinfra/Qwen/Qwen2.5-7B-InstructSource: Models.dev data33K$0.04$0.10
 Flowdotqwen/qwen-2.5-7b-instructSource: FlowDot data33K$0.04$0.10
 OpenRouterqwen/qwen-2.5-7b-instructSource: GenAI Prices dataNot published by the provider$0.04$0.10
 DeepInfradeepinfra/Qwen/Qwen2.5-7B-InstructSource: LiteLLM data33K$0.04$0.10
 302aiPro/Qwen/Qwen2.5-7B-InstructSource: 302.ai data32K$0.05$0.05
 SiliconFlowQwen/Qwen2.5-7B-InstructSources: Models.dev data, SiliconFlow data33K$0.05$0.05
 Novita AInovita/qwen/qwen2.5-7b-instructSource: LiteLLM data32K$0.07$0.07
 Redpillqwen/qwen-2.5-7b-instructSource: RedPill data33K$0.10$0.20
 Phalaphala/qwen-2.5-7b-instructSources: Models.dev data, Phala Network data33K$0.10$0.20
 Fireworks AIfireworks_ai/accounts/fireworks/models/qwen2p5-7b-instructSource: LiteLLM data33K$0.20$0.20
Show all 13 listings

Showing 10 of 13: the cheapest per 1M input tokens from each provider.

Also sold by Aihubmix, Hugging Face, Simplismart.

3 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Math

GSM8KSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
LiveBenchSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
mu-MATH7 related benchmarks · 35 results
F1
Source: U-MATH and mu-MATH
F1 · Qwen/Qwen2.5-72B-Instruct
accuracy
Source: U-MATH and mu-MATH
accuracy · Qwen/Qwen2.5-72B-Instruct
MCC
Source: U-MATH and mu-MATH
MCC · Qwen/Qwen2.5-72B-Instruct
NPV
Source: U-MATH and mu-MATH
NPV · Qwen/Qwen2.5-72B-Instruct
PPV
Source: U-MATH and mu-MATH
PPV · Qwen/Qwen2.5-72B-Instruct
TNR
Source: U-MATH and mu-MATH
TNR · Qwen/Qwen2.5-72B-Instruct
Show 5 more resultsHide 5 results
TPR
Source: U-MATH and mu-MATH
TPR · Qwen/Qwen2.5-72B-Instruct
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06

Coding

CodeElo28 related benchmarks · 28 results
HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

INCLUDE-base-44 0-shot26 related benchmarks · 26 results

Agentic

GAIA4 results
Source: GAIA Leaderboard data · Jun 2025
Difficulty level
Difficulty not reported

Factuality

LLM-AggreFact12 related benchmarks · 12 results
CNN
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, CNN, renderer-v1
all-11 mean
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, all-11 mean, renderer-v1
ClaimVerify
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, ClaimVerify, renderer-v1
ExpertQA
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, ExpertQA, renderer-v1
FactCheck
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, FactCheck, renderer-v1
LFQA
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, LFQA, renderer-v1
Show 6 more resultsHide 6 results
MediaS
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, MediaS, renderer-v1
MeetB
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, MeetB, renderer-v1
RAGTruth
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, RAGTruth, renderer-v1
REVEAL
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, REVEAL, renderer-v1
WiCE
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, WiCE, renderer-v1
XSum
Source: LLM-AggreFact data
Qwen2.5-7B-Instruct, grounded claim checker, XSum, renderer-v1

Multilingual

General

MultiPL-ESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Instruction following

Reasoning

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Human preference

MT-BenchSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

FinBen66 related benchmarks · 66 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 60 more resultsHide 60 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Acc
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFP Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Macro F1
EFP MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, MCC
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Acc
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
EFPA Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Macro F1
EFPA MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, MCC
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Acc
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinanceES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Macro F1
FinanceES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, MCC
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FINER-ORD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, F1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Acc
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
MultiFin-ES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Macro F1
MultiFin-ES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, MCC
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Acc
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1
TSA-Spanish Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Macro F1
TSA-Spanish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, MCC
Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: ACEBench, MIT (licence) · Data by LLM Stats · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · CodeElo (Qwen). Aggregate scores from the official results file; no results licence asserted. The evaluation scaffold agreement is not presented as a licence for these scores · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Speakleash community evaluation of INCLUDE-base-44 (Romanou et al., arXiv:2411.19799). Public results.csv; no results licence stated. · Vasselli, Martínez Peguero, Hudi, Sakajo and Watanabe. Measuring Linguistic Competence of LLMs on Indigenous Languages of the Americas. EACL 2026, ©2026 ACL, CC BY 4.0. Numeric/protocol extract from Tables 1–4; random reference rows omitted. (licence) · LLM-AggreFact, Tang et al. Public numeric grounded checker balanced accuracy; results licence not separately established. · M-IFEval: Dussolle, Cardeña Díaz, Sato and Devine (Lightblue), arXiv:2502.04688. README leaderboard, repository licensed Apache-2.0. (licence) · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · OpenLLM French Leaderboard (le-leadboard), Mohamad Alhajar and Alexandre Lavallée; publisher-normalized public result files; results licence not stated (the Space's Apache-2.0 covers code) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · WebWalkerQA (Alibaba NLP), Apache-2.0 (licence)

Also known as: deepinfra/qwen/qwen2.5-7b-instruct, fireworks_ai/accounts/fireworks/models/qwen2p5-7b-instruct, novita/qwen/qwen2.5-7b-instruct, phala/qwen-2.5-7b-instruct, pro/qwen/qwen2.5-7b-instruct, qwen/qwen-2.5-7b-instruct, qwen/qwen2.5-7b-instruct, qwen2-5-7b-instruct, sophnet/qwen2.5-7b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works