Skip to content

Databricks · Chat

DBRX-instruct

Databricks 🇺🇸Chat
llminfo IQ
96.9
Market median price
$1.20 blended / 1M
Max context
33K
Listings
3

Evidence and sources

llminfo IQ 96.9, ranked among chat models. From 147 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 27 Mar 2024Maker HQ: US (source)
Sources: LiteLLM data, llminfo researchPrimary data from LiteLLM from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

as stated by the model's providers
Text
Text

Listings

 Flowdotdatabricks/dbrx-instructSource: FlowDot data33K$1.20$1.20
 Fireworks AIfireworks_ai/accounts/fireworks/models/dbrx-instructSource: LiteLLM data33K$1.20$1.20

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score

Knowledge

HELM59 related benchmarks · 59 results
Show 53 more resultsHide 53 results

Long context

Reasoning

Coding

Math

Science

General

Factuality

Instruction following

Multilingual

Speech

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · NVIDIA RULER, Hsieh et al. Official README numeric table; no separate results licence asserted.

Around the web

  • Databricks Launches DBRX, A New Standard for Efficient Open Source Models - Databricks
    March 27, 2024 Databricks Launches DBRX, A New Standard for Efficient Open Source Models DBRX …March 27, 2024 Databricks Launches DBRX, A New Standard for Efficient Open Source Models DBRX empowers organizations to build production-quality generative AI applications efficiently and gives them …

    databricks.com

  • Introducing DBRX: A New State-of-the-Art Open LLM | Databricks Blog
    outperforms established open source models on language understanding (MMLU), Programming (HumanEval), and Math (GSM8K). The …outperforms established open source models on language understanding (MMLU), Programming (HumanEval), and Math (GSM8K). The weights of the base model ( DBRX Base ) and the finetuned model ( DBRX Inst…

    databricks.com

  • Announcing DBRX: A new standard for efficient open source LLMs | Databricks Blog
    Towards that, we designed DBRX to be easily customizable so that enterprises can improve the …Towards that, we designed DBRX to be easily customizable so that enterprises can improve the quality of their AI applications. Starting today on the Databricks Platform, enterprises can interact with…

    databricks.com

  • Meet DBRX, the New Standard for High-Quality LLMs | Databricks
    open source foundation model that sets the standard for quality and efficiency. With up to …open source foundation model that sets the standard for quality and efficiency. With up to 3x faster inference, DBRX outperforms all other open models in quality benchmarks — and that allows you to q…

    databricks.com

  • DBRX: A New Standard for Open Source LLMs | Databricks
    DBRX sets a new standard for efficient LLMs. It outperforms all existing open source models …DBRX sets a new standard for efficient LLMs. It outperforms all existing open source models as well as GPT 3.5 on standard benchmarks. DBRX plus Databricks helps developers deploy production-quality …

    databricks.com

  • Discover DBRx: Revolutionizing High-Quality LLMs for AI | Databricks
    If you’re using off-the-shelf LLMs to build GenAI applications, you’re probably struggling with quality, privacy …If you’re using off-the-shelf LLMs to build GenAI applications, you’re probably struggling with quality, privacy and governance issues. What you need is a way to cost-effectively build a custom LLM t…

    databricks.com

  • Building DBRX-class Custom LLMs with Databricks Training | Databricks Blog
    by Anna Pfohl , Cheng Li , Mihir Patel , Wai Wu , Will Gleich …by Anna Pfohl , Cheng Li , Mihir Patel , Wai Wu , Will Gleich , Ajay Saini and Hagay Lupesko We recently introduced DBRX : an open, state-of-the-art, general-purpose LLM. DBRX was trained, fine-tuned…

    databricks.com

  • Accelerated DBRX Inference on Databricks Model Serving | Databricks Blog
    In this blog post we dive into inference with DBRX, the open state-of-the-art large language …In this blog post we dive into inference with DBRX, the open state-of-the-art large language model (LLM) created by Databricks (see Introducing DBRX ). We discuss how DBRX was designed from the groun…

    databricks.com

  • DBRX Models - Databricks Marketplace
    Product details DBRX Instruct can be deployed directly to Databricks Model Serving for immediate use, …Product details DBRX Instruct can be deployed directly to Databricks Model Serving for immediate use, or loaded for fine-tuning or batch inference use cases. DBRX Base can be used for further fine-tu…

    marketplace.databricks.com

  • Databricks Launches DBRX, A New Standard for Efficient Open Source Models
    for all enterprises. A recent survey from Andreessen Horowitz found that nearly 60 percent of …for all enterprises. A recent survey from Andreessen Horowitz found that nearly 60 percent of AI leaders are interested in increasing open source usage or switching when fine-tuned open source models…

    prnewswire.com

Also known as: databricks/dbrx-instruct, fireworks_ai/accounts/fireworks/models/dbrx-instruct, nvidia_nim/databricks/dbrx-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works