Skip to content

Alibaba · Chat

Qwen2.5 32B Instruct

Alibaba 🇨🇳ChatQwen family

Open Source Qianwen 32B

llminfo IQ
109.0
Market median price
$0.18 blended / 1M
Max context
128K
Listings
5

Evidence and sources

International storefront (alibabacloud.com) is Singapore-incorporated; mainland operating entity 杭州阿里云智能科技有限公司 (Hangzhou).

🤗 Qwen/Qwen2.5-32B-Instructllminfo IQ 109.0, ranked among chat models. From 108 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 77.8, 95% interval 67–88. From 5 benchmark families across 3 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.How Coding IQ is computedReleased 17 Sep 2024Maker HQ: CN (source)
Sources: Together AI data, 302.ai data, Hugging FacePrimary data from Together AI from 302.ai: description from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Function calling

Listings

 302aiQwen/Qwen2.5-32B-InstructSource: 302.ai data32K$0.18$0.18
 AihubmixQwen/Qwen2.5-32B-InstructSource: AIHubMix data docsNot published by the provider$0.60$0.60
 Fireworks AIfireworks_ai/accounts/fireworks/models/qwen2p5-32b-instructSource: LiteLLM data33K$0.90$0.90
 Nebius AI Studionebius/Qwen/Qwen2.5-32B-InstructSource: LiteLLM data128K$0.06$0.20

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Coding

CodeElo28 related benchmarks · 28 results
HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPP+Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Math

GSM8KSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
TheoremQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06

General

MultiPL-ESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Agentic

WebWalkerQA7 results
Source: WebWalkerQA data
Show 1 more resultHide 1 result

Factuality

FaithJudge Hallucination RateSource: FaithJudge data

Instruction following

Reasoning

ARC-CSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
BBHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HellaSwagSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: Data by LLM Stats · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · CodeElo (Qwen). Aggregate scores from the official results file; no results licence asserted. The evaluation scaffold agreement is not presented as a licence for these scores · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · M-IFEval: Dussolle, Cardeña Díaz, Sato and Devine (Lightblue), arXiv:2502.04688. README leaderboard, repository licensed Apache-2.0. (licence) · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · WebWalkerQA (Alibaba NLP), Apache-2.0 (licence)

Also known as: fireworks_ai/accounts/fireworks/models/qwen2p5-32b-instruct, nebius/qwen/qwen2.5-32b-instruct, qwen/qwen2.5-32b-instruct, sophnet/qwen2.5-32b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works