Skip to content

Meta · Chat

Llama 3.1 8B Instant

Meta 🇺🇸ChatLlama familyOpen weights. One of its sources says the weights are publicly available.
From Fastrouter's listing:
Llama 3.1 8B Instruct is Meta's compact, efficiency-focused language model from the Llama 3.1 family. At just 8 billion parameters, this instruction-tuned variant delivers impressive performance with minimal computational requirements, making it ideal for resource-constrained environments and latency-sensitive applications. Despite its smaller size, the model maintains competitive performance in human evaluations against much larger models, particularly excelling in straightforward dialogue, content generation, and common instruction-following tasks. The model features improved inference speed and reduced deployment costs compared to larger variants while maintaining the core capabilities that make Llama models effective. It's particularly well-suited for mobile applications, edge devices, and scaled deployments where efficiency and performance balance are critical considerations.
Market median price
$0.0575 blended / 1M
Max context
131K
Listings
3
Providers
3

Evidence and sources

Sources: GenAI Prices data, AIHubMix data docs, Models.dev data, FastRouter dataPrimary data from GenAI Prices from AIHubMix: name from Models.dev: weights availability from FastRouter: description

Advantages and trade-offs

Compared with 10 representative chat models

Advantages

Open weights available

The weights are public. 4 of the 10 peers that say either way have open weights.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Function callingStructured output

Listings

 Aihubmixdeepinfra-llama-3.1-8b-instantSource: AIHubMix data docsNot published by the provider$0.033$0.055
 Fastroutermeta-llama/llama-3.1-8b-instantSource: FastRouter data8K$0.22$0.22
 Groqllama-3.1-8b-instantSources: GenAI Prices data, Groq documentation, Models.dev data131K$0.05$0.08

These providers advertise this model. Researchers have found some resellers serving a different, cheaper model, so see how to check whether a provider meets your needs.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Instruction following

Other

Data credits: KazBench by Yersultan Akhmer. Provisional DEV numeric results; code MIT and task-data CC BY 4.0 do not establish a separate score licence.

Around the web

  • llama-3.1-70b-instruct Model by Meta
    Section: > llama-3.1-70b-instruct Model by Meta - NVIDIA Build Powers complex conversations with superior contextual …Section: > llama-3.1-70b-instruct Model by Meta - NVIDIA Build Powers complex conversations with superior contextual understanding, reasoning and text generation. Experience Model Card Deploy System …

    build.nvidia.com

  • meta / llama-3.1-70b-instruct
    updatedAt: 2026-08-06T09:58:22.000Z meta / llama-3.1-70b-instruct Model Information The Meta Llama 3.1 collection of multilingual large …updatedAt: 2026-08-06T09:58:22.000Z meta / llama-3.1-70b-instruct Model Information The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instru…

    docs.api.nvidia.com

  • llama-3.1-8b-instruct Model by Meta | NVIDIA NIM
    title: "llama-3.1-8b-instruct" publisher: "meta" type: "endpoint" updated: "2025-07-09T14:53:02.421Z" description: "Advanced state-of-the-art model with language understanding, …title: "llama-3.1-8b-instruct" publisher: "meta" type: "endpoint" updated: "2025-07-09T14:53:02.421Z" description: "Advanced state-of-the-art model with language understanding, superior reasoning, an…

    build.nvidia.com

  • meta / llama-3.1-8b-instruct - Nvidia
    updatedAt: 2026-08-06T09:58:21.000Z meta / llama-3.1-8b-instruct Model Information The Meta Llama 3.1 collection of multilingual large …updatedAt: 2026-08-06T09:58:21.000Z meta / llama-3.1-8b-instruct Model Information The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruc…

    docs.api.nvidia.com

  • Meta releases Llama 3.1 open-source AI model to take on OpenAI | The Verge
    same dynamic to play out with AI, writing, “I believe the Llama 3.1 release will …same dynamic to play out with AI, writing, “I believe the Llama 3.1 release will be an inflection point in the industry where most developers begin to primarily use open source.” To help get Llama 3.…

    theverge.com

  • Llama 3.1 Community License Agreement - developer.meta.com
    Section: > Llama 3.1 Community License Agreement - Meta for Developers “Agreement” means the terms …Section: > Llama 3.1 Community License Agreement - Meta for Developers “Agreement” means the terms and conditions for use, reproduction, distribution and modification of the Llama Materials set forth…

    developer.meta.com

  • Llama 3.1 on Vertex AI | Google Cloud Blog
    Using Llama 3.1 in Google Cloud Google Cloud’s Vertex AI is a comprehensive AI platform …Using Llama 3.1 in Google Cloud Google Cloud’s Vertex AI is a comprehensive AI platform for experimenting with, customizing, and deploying, and monitoring foundation models like Llama 3.1. Llama 3.1 …

    cloud.google.com

  • Meta Llama 3.1 (405B) - docs.oracle.com
    Português (Brasil) Oracle Cloud Infrastructure Documentation All Pages Skip to main content Updated 2026-05-15 Meta …Português (Brasil) Oracle Cloud Infrastructure Documentation All Pages Skip to main content Updated 2026-05-15 Meta Llama 3.1 (405B) (Deprecated) Base Model · Fine-Tuning Cluster · Hosting Cluster · …

    docs.oracle.com

  • Llama 3.1
    Home Technologies Meta Llama 3.1 Upcoming AI Hackathons For Innovators & Creators Llama 3.1 Llama …Home Technologies Meta Llama 3.1 Upcoming AI Hackathons For Innovators & Creators Llama 3.1 Llama 3.1 is a state-of-the-art open-source large language model (LLM) by Meta AI, optimized for advanced N…

    lablab.ai

  • finalend/llama-3.1-storm:8b-q8_0 - Ollama
    Messages }} {{- if or .System .Tools }} system {{ .System 1.7kB params { "stop": …Messages }} {{- if or .System .Tools }} system {{ .System 1.7kB params { "stop": [ " ", " ", " " 96B license LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agree…

    ollama.com

Also known as: deepinfra-llama-3.1-8b-instant, groq-llama-3.1-8b-instant, meta-llama/llama-3.1-8b-instant

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works