Skip to content

Alibaba · Chat

QwQ 32B Preview

Alibaba 🇨🇳ChatQwQ family
llminfo IQ
102.9
Market median price
$0.4325 blended / 1M
Max context
33K
Listings
5

Evidence and sources

International storefront (alibabacloud.com) is Singapore-incorporated; mainland operating entity 杭州阿里云智能科技有限公司 (Hangzhou).

🤗 Qwen/QwQ-32B-Previewllminfo IQ 102.9, ranked among chat models. From 103 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 76.8, 95% interval 64–89. From 4 benchmark families across 4 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (33.9). Costs more per task than its benchmark results predict. From 2 benchmarks with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksReleased 27 Nov 2024Maker HQ: CN (source)
Sources: LMArena data, AIHubMix data docs, Hugging FacePrimary data from LMArena from AIHubMix: name from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 2 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 302aiqwq-32b-previewSource: 302.ai data33K$0.29$0.86
 AihubmixQwen/QwQ-32B-PreviewSource: AIHubMix data docsNot published by the provider$0.16$0.16
 FlowdotQwen/QwQ-32B-PreviewSource: FlowDot data33K$1.20$1.20
 OpenRouterqwen/qwq-32b-previewSource: GenAI Prices dataNot published by the provider$0.20$0.20
 Fireworks AIfireworks_ai/accounts/fireworks/models/qwen-qwq-32b-previewSource: LiteLLM data33K$0.90$0.90

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Math

MATH-500Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
mu-MATH7 related benchmarks · 35 results
F1
Source: U-MATH and mu-MATH
F1 · Qwen/Qwen2.5-72B-Instruct
accuracy
Source: U-MATH and mu-MATH
accuracy · Qwen/Qwen2.5-72B-Instruct
MCC
Source: U-MATH and mu-MATH
MCC · Qwen/Qwen2.5-72B-Instruct
NPV
Source: U-MATH and mu-MATH
NPV · Qwen/Qwen2.5-72B-Instruct
PPV
Source: U-MATH and mu-MATH
PPV · Qwen/Qwen2.5-72B-Instruct
TNR
Source: U-MATH and mu-MATH
TNR · Qwen/Qwen2.5-72B-Instruct
Show 5 more resultsHide 5 results
TPR
Source: U-MATH and mu-MATH
TPR · Qwen/Qwen2.5-72B-Instruct
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06

Coding

CodeElo28 related benchmarks · 28 results

Human preference

Factuality

LLM-AggreFact12 related benchmarks · 12 results
CNN
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, CNN, renderer-v1
all-11 mean
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, all-11 mean, renderer-v1
ClaimVerify
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, ClaimVerify, renderer-v1
ExpertQA
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, ExpertQA, renderer-v1
FactCheck
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, FactCheck, renderer-v1
LFQA
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, LFQA, renderer-v1
Show 6 more resultsHide 6 results
MediaS
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, MediaS, renderer-v1
MeetB
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, MeetB, renderer-v1
RAGTruth
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, RAGTruth, renderer-v1
REVEAL
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, REVEAL, renderer-v1
WiCE
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, WiCE, renderer-v1
XSum
Source: LLM-AggreFact data
QwQ-32B-Preview, grounded claim checker, XSum, renderer-v1

General

Reasoning

Instruction following

Knowledge

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

Data credits: Data by LLM Stats · LMArena, CC BY 4.0 (licence) · CodeElo (Qwen). Aggregate scores from the official results file; no results licence asserted. The evaluation scaffold agreement is not presented as a licence for these scores · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · LLM-AggreFact, Tang et al. Public numeric grounded checker balanced accuracy; results licence not separately established. · MathArena (ETH SRI / INSAIT), MIT — cite dekoninck2026matharena (licence) · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)

Around the web

Also known as: fireworks_ai/accounts/fireworks/models/qwen-qwq-32b-preview, qwen/qwq-32b-preview

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works