Skip to content

DeepSeek · Chat

DeepSeek V3

DeepSeek 🇨🇳ChatDeepSeek familyOne of its sources says the weights aren't publicly available.The maker lists this model as deprecated (13 Jul 2026).

Newer version: DeepSeek V4. Our catalogue has no release date for DeepSeek V4. We compared the version names in our catalogue.

From Meganova's listing:
High-performance open-source MoE language model optimized for reasoning, coding, and efficient text generation
llminfo IQ
114.5
Max context
164K
Listings
66

Evidence and sources

🤗 deepseek-ai/DeepSeek-V3llminfo IQ 114.5, ranked among chat models. From 492 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 85.3, 95% interval 79–92. From 14 benchmark families across 15 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (43.6). Costs more per task than its benchmark results predict. From 26 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTypical (47 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.Median 4,587 output tokens per task at default effort.How the Yap score worksReleased 26 Dec 2024Maker HQ: CN (according to DeepSeek's own website)
All rankings: #72 on NanoGPT recentlySources: LMArena data, DeepInfra data, LiteLLM data, Models.dev data, Simplismart Pricing, MegaNova data, llminfo researchPrimary data from LMArena from DeepInfra: name from LiteLLM: deprecation date from Models.dev: weights availability from Simplismart Pricing: primary mode from MegaNova: description from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecated by its maker

The maker has already deprecated this model (13 Jul 2026).

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

ReasoningFunction callingStructured outputPrompt caching

Listings

 DeepSeekdeepseek/deepseek-v3Source: LiteLLM data66K$0.27cache read $0.07$1.10——
 Hyperbolichyperbolic/deepseek-ai/DeepSeek-V3Source: LiteLLM data33K$0.20$0.20——
 Lambda AIlambda_ai/deepseek-v3-0324 · 0324Source: LiteLLM data131K$0.20$0.60——
 Submodeldeepseek-ai/DeepSeek-V3-0324 · 0324Source: Models.dev data75K$0.20$0.80——
 Eden AIInference by DeepInfradeepinfra/deepseek-ai/DeepSeek-V3-0324 · 0324Source: Models.dev data164K$0.24cache read $0.135$0.90——
 Hugging FaceInference by DeepInfradeepseek-ai/DeepSeek-V3-0324 · 0324Source: Hugging Face Inference Providers data164K$0.24$0.90——
 DeepInfradeepinfra/deepseek-ai/DeepSeek-V3-0324 · 0324Sources: LiteLLM data, Models.dev data164K$0.24cache read $0.135$0.90——
 Alibaba Cloud (China)siliconflow/deepseek-v3-0324 · 0324Source: Models.dev data164K$0.25$1.00——
 SiliconFlowdeepseek-ai/DeepSeek-V3Sources: Models.dev data, SiliconFlow data164K$0.25$1.00——
 NanoGPTInference by SiliconFlowRegions: 🇸🇬 SGdeepseek-v3-0324 · 0324 · fp8Source: NanoGPTNot published by the provider$0.2625$1.0526.64,067ms

4 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Knowledge

HELM60 related benchmarks · 60 results
Show 54 more resultsHide 54 results
MMLU33 related benchmarks · 33 results
MMLU
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Pro
Source: Hugging Face Official Benchmarks data · Reported by the model's developer. The source relaying it did not verify it. claim
Show 27 more resultsHide 27 results

Coding

LiveCodeBench8 related benchmarks · 9 results
LiveCodeBench
Source: LiveCodeBench Leaderboard data
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
AtCoder
Source: LiveCodeBench Leaderboard data
Codeforces
Source: LiveCodeBench Leaderboard data
platform:codeforces
Easy
Source: LiveCodeBench Leaderboard data
Hard
Source: LiveCodeBench Leaderboard data
LeetCode
Source: LiveCodeBench Leaderboard data
Show 2 more resultsHide 2 results
Medium
Source: LiveCodeBench Leaderboard data
Pro
Source: LiveCodeBench Pro data · Oct 2025
Multi-SWE-bench9 related benchmarks · 27 results
C Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
C++ Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
Go Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
Java Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
JavaScript Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
Lite All Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
Show 9 more resultsHide 9 results
Python Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_Agentless_DeepSeek-V3
MopenHands, 20250329_OpenHands_DeepSeek-V3
MSWE-agent, 20250329_SWE-agent_DeepSeek-V3
Rust Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
TypeScript Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_DeepSeek-V3
MopenHands, 20250329_MopenHands_DeepSeek-V3
MSWE-agent, 20250329_MSWE-agent_DeepSeek-V3
SWE-bench Verified12 related benchmarks · 21 results
SWE-bench Verified
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
SWE-bench-Live Lite
Source: SWE-bench-Live leaderboard data · May 2025
By scaffold · set: lite · instances: 300
SWE-rebench 2025-01
Source: SWE-rebench
SWE-rebench 2025-02
Source: SWE-rebench
SWE-rebench 2025-03
Source: SWE-rebench
SWE-rebench 2025-04
Source: SWE-rebench
Show 9 more resultsHide 9 results
SWE-rebench 2025-05
Source: SWE-rebench
SWE-rebench 2025-06
Source: SWE-rebench
SWE-rebench 2025-07
Source: SWE-rebench

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score
PhareSource: Phare

Human preference

Arena ELO27 related benchmarks · 53 results
Source: LMArena data · Nov 2026
Benchmarknot stated0324
Arena ELO
Chinese
Creative Writing
English
Show 23 more benchmarksHide 23 benchmarks
Benchmarknot stated0324
Exclude Ties
Expert
French
German
Hard Prompts
Hard Prompts English
Industry Business and Management and Financial Operations
Industry Entertainment and Sports and Media
Industry Life and Physical and Social Science
Industry Mathematical
Industry Medicine and Healthcare
Industry Software and It Services
Industry Writing and Literature and Language
Japanese
Korean
Longer Query
Multi Turn
Non English
PolishNot measured
Russian
Spanish
Style-Controlled

Math

AIME 2024Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
CNMO 2024Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATH-500Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06
ValsSource: Vals AI

Multilingual

Agentic

hal-gaiaSource: HAL (Princeton)

Reasoning

C-EvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
CLUEWSCSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
DROPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
FRAMESSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Science

Long context

Factuality

CSimpleQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
SimpleQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Instruction following

IFEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Speech

Vision

Other

FinBen61 related benchmarks · 61 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 55 more resultsHide 55 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
ECTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BartScore
ECTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BertScore
ECTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, Rouge-1
EDTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BartScore
EDTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BertScore
EDTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, Rouge-1
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, ACC
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, ACC
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, ACC
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, ACC
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, ACC
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1
Indigenous Americas19 related benchmarks · 19 results
Show 13 more resultsHide 13 results
Nejumi 428 related benchmarks · 28 results
ValsSource: Vals AI

Data credits: Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · CSEBenchmark (Wang et al., IEEE S&P 2025). Copyright (c) 2024 NASP. MIT License. (licence) · CyberGym leaderboard (Wang, Shi, He, Cai, Zhang, Song; UC Berkeley), ICLR 2026. Results evaluated and submitted by the listed teams. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only. · DABstep (Adyen), CC BY 4.0 (licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Galileo Agent Leaderboard, Apache-2.0 (licence) · Hugging Face official benchmark leaderboards; licence varies by benchmark · HAL (Princeton) — cite the HAL paper · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · JMLE2026-Bench and IgakuQA119 by Naoto Iwase; results licence not stated (code MIT, question data CC BY 4.0). · Vasselli, Martínez Peguero, Hudi, Sakajo and Watanabe. Measuring Linguistic Competence of LLMs on Indigenous Languages of the Americas. EACL 2026, ©2026 ACL, CC BY 4.0. Numeric/protocol extract from Tables 1–4; random reference rows omitted. (licence) · LiveMCPBench leaderboard, ICIP-CAS (Mo et al., 2025). Sheet linked from the Apache-2.0 project README; sheet licence not separately stated. · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MathArena (ETH SRI / INSAIT), MIT — cite dekoninck2026matharena (licence) · MMLU-ProX: Xuan et al., arXiv:2503.10497. Public project-page results; no results licence stated. · Multi-SWE-bench experiments (multi-swe-bench/experiments), Apache-2.0; resolved-rate fractions converted to percentages (licence) · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · Phare (Giskard), CC BY 4.0 (licence) · Trishul Lab, PutnamBench public submitted results. Model identities and scaffold budgets preserved; result licence unstated. · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · SWE-bench-Live (Microsoft and contributors), swe-bench-live.github.io. Resolve rates computed from the published report counts. · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted. · Vectara Hallucination Leaderboard, Apache-2.0 (licence) · WebWalkerQA (Alibaba NLP), Apache-2.0 (licence)

Also known as: accounts/fireworks/models/deepseek-v3, azure_ai/deepseek-v3-0324, baseten/deepseek-ai/deepseek-v3-0324, bedrock/ap-northeast-1/deepseek.v3-v1:0, bedrock/ap-south-1/deepseek.v3-v1:0, bedrock/ap-southeast-3/deepseek.v3-v1:0, bedrock/eu-west-2/deepseek.v3-v1:0, cc-deepseek-v3, crusoe/deepseek-ai/deepseek-v3-0324, deepinfra/deepseek-ai/deepseek-v3, deepinfra/deepseek-ai/deepseek-v3-0324, deepseek-ai/deepseek-v3, deepseek-ai/deepseek-v3-0324, deepseek-v3-0324, deepseek-v3-20250324, deepseek-v3-250324, deepseek-v3-aliyun, deepseek-v3-baidu, deepseek-v3-huoshan, deepseek.v3-v1:0, deepseek/deepseek-v3, deepseek/deepseek-v3-0324, deepseek/deepseek_v3, fireworks_ai/accounts/fireworks/models/deepseek-v3, fireworks_ai/accounts/fireworks/models/deepseek-v3-0324, gmi/deepseek-ai/deepseek-v3-0324, hyperbolic/deepseek-ai/deepseek-v3, hyperbolic/deepseek-ai/deepseek-v3-0324, lambda_ai/deepseek-v3-0324, nebius/deepseek-ai/deepseek-v3, nebius/deepseek-ai/deepseek-v3-0324, novita/deepseek/deepseek-v3-0324, novita/deepseek/deepseek_v3, pro/deepseek-ai/deepseek-v3, public/deepseek-v3, replicate/deepseek-ai/deepseek-v3, siliconflow/deepseek-v3-0324, sophnet/deepseek-v3, sophnet/deepseek-v3-0324, sophnet/deepseek-v3-fast, streamlake/deepseek-v3, together_ai/deepseek-ai/deepseek-v3, vercel_ai_gateway/deepseek/deepseek-v3

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works