Skip to content

Meta · Chat

Llama 3.1 8B Instruct

Meta 🇺🇸ChatLlama familyOpen weights. One of its sources says the weights are publicly available.

Newer version: Llama-3.3-8B-Instruct. Our catalogue has no release date for Llama-3.3-8B-Instruct. We compared the version names in our catalogue.

From NanoGPT's listing:
Meta's Llama 3.1 8B model on an open permissionless network
llminfo IQ
95.6
Market median price
$0.0586 blended / 1M
Max context
131K
Listings
60

Evidence and sources

🤗 meta-llama/Llama-3.1-8B-Instruct8B params Model architecture, as its sources state it llminfo IQ 95.6, ranked among chat models. From 343 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 69.9, 95% interval 61–79. From 5 benchmark families across 6 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (39.5). Costs more per task than its benchmark results predict. From 5 benchmarks with measured task costs. A fair amount of data behind it.How Value for money worksReleased 18 Jul 2024 Training-data cutoff, as its sources state it Maker HQ: US (according to Meta's own website)
All rankings: #17 in Wikipedia pageviews this week #18 in Bluesky discussions this week #137 on OpenRouter today #143 on OpenRouter this month #145 on OpenRouter this week #352 on NanoGPT recentlyAll rankings: #17 in Wikipedia pageviews this week #18 in Bluesky discussions this week #137 on OpenRouter today #143 on OpenRouter this month #145 on OpenRouter this week #352 on NanoGPT recentlySources: LMArena data, flex.ai API data, Models.dev data, Morpheus Inference Marketplace data, OpenRouter data docs, NanoGPT, Hugging FacePrimary data from LMArena from flex.ai API: hugging face id from Models.dev: weights availability from Morpheus Inference Marketplace: architecture, parameter count from OpenRouter: knowledge cutoff from NanoGPT: description from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Open weights available

The weights are public. 3 of the 7 peers that say either way have open weights.

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 5 maker's prices; 5 market median prices.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

VisionFunction callingStructured outputPrompt caching

Listings

 Aihubmixmeta-llama/llama-3.1-8b-instruct:free · freeSource: AIHubMix data docsNot published by the provider$0.02$0.02——
 Flowdotmeta-llama/llama-3.1-8b-instructSource: FlowDot data16K$0.02$0.05——
 Hugging FaceInference by DeepInframeta-llama/Llama-3.1-8B-InstructSource: Hugging Face Inference Providers data131K$0.02$0.04——
 Kilometa-llama/llama-3.1-8b-instructSources: Kilo AI Gateway data, Models.dev data131K$0.02$0.04——
 NanoGPTmeta-llama/llama-3.1-8b-instructSources: Models.dev data, NanoGPT131K$0.02cache read $0.01$0.04——
 Nous Portalmeta-llama/llama-3.1-8b-instructSource: Nous Portal Inference Gateway data131K$0.02$0.04——
 OpenRouterInference by DeepInframeta-llama/llama-3.1-8b-instruct · fp8Source: OpenRouter data docs131K$0.02$0.0439558.5ms
 Abacusmeta-llama/Meta-Llama-3.1-8B-InstructSource: Models.dev data128K$0.02$0.05——
 Nebius AI Studionebius/meta-llama/Meta-Llama-3.1-8B-InstructSource: LiteLLM data128K$0.02$0.06——
 Novita AImeta-llama/llama-3.1-8b-instruct · fp8Sources: GenAI Prices data, LiteLLM data, Models.dev data, Novita AI data16K$0.02$0.05——

6 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Multilingual

Benchmark Nusantara20 related benchmarks · 20 results
Show 14 more resultsHide 14 results
IndicParam42 related benchmarks · 42 results
Show 36 more resultsHide 36 results
SeaLLMs16 related benchmarks · 16 results
Show 10 more resultsHide 10 results

Math

mu-MATH7 related benchmarks · 35 results
F1
Source: U-MATH and mu-MATH
F1 · Qwen/Qwen2.5-72B-Instruct
accuracy
Source: U-MATH and mu-MATH
accuracy · Qwen/Qwen2.5-72B-Instruct
MCC
Source: U-MATH and mu-MATH
MCC · Qwen/Qwen2.5-72B-Instruct
NPV
Source: U-MATH and mu-MATH
NPV · Qwen/Qwen2.5-72B-Instruct
PPV
Source: U-MATH and mu-MATH
PPV · Qwen/Qwen2.5-72B-Instruct
TNR
Source: U-MATH and mu-MATH
TNR · Qwen/Qwen2.5-72B-Instruct
Show 5 more resultsHide 5 results
TPR
Source: U-MATH and mu-MATH
TPR · Qwen/Qwen2.5-72B-Instruct
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06

Coding

CodeElo28 related benchmarks · 28 results
HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

Science

ChemBench10 related benchmarks · 20 results
Source: ChemBench verified leaderboard data docs
Benchmarkllama3.1-8b-instruct-T-onellama3.1-8b-instruct
ChemBench
Analytical Chemistry
Chemical Preference
General Chemistry
Show 6 more benchmarksHide 6 benchmarks
Benchmarkllama3.1-8b-instruct-T-onellama3.1-8b-instruct
Inorganic Chemistry
Materials Science
Organic Chemistry
Physical Chemistry
Technical Chemistry
Toxicity and Safety
GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GPQA Diamond7 results
Source: OpenEvals Leaderboard data · Reported by the model's developer. The source relaying it did not verify it. · Mar 2026
Setting not stated
Source: OpenRouter benchmark exports
llama-3.1-8b-instruct · 90-day results
Across 5 providers lowest 0.168% median 26.1% highest 29.2%OpenRouter's automatic routing 27.1%
Show results from 5 providers and OpenRouter's automatic routingHide results from 5 providers and OpenRouter's automatic routing
  • Groq
  • OpenRouter's automatic routing
  • CoreWeave
  • DeepInfra
  • Novita
  • Cloudflare

Human preference

Arena ELO26 related benchmarks · 26 results

Instruction following

IFEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Long context

BABILong avg(qa1-5)9 related benchmarks · 9 results
0k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 0k
1k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 1k
2k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 2k
4k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 4k
8k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 8k
16k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 16k
Show 3 more resultsHide 3 results
32k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 32k
64k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 64k
128k
Source: BABILong v0 data docs
Meta-Llama-3.1-8B-Instruct, avg, 128k

Reasoning

API-BankSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ARC-CSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
DROPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Agentic

BFCLSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
NexusSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Factuality

FaithJudge Hallucination RateSource: FaithJudge data

Safety

PhareSource: Phare

Other

Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: ACEBench, MIT (licence) · SEA-HELM leaderboard, AI Singapore (AI Products team), National University of Singapore. Published aggregate scores; results licence not stated (SEA-HELM code is MIT). · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · RMT-team, Kuratov et al. Official v0 numeric CSV; results licence not separately stated. · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Benchmark Nusantara, ibahasa (M. Khoirul Huda), doi:10.5281/zenodo.21970463. Test results CC BY 4.0, attribution to ibahasa; aggregate results CSV only. (licence) · BullshitBench by Peter Gostev, MIT (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · ChemBench leaderboard, Jablonka group / lamalab-org. Public verified numeric result summaries; results licence not separately stated. · CodeElo (Qwen). Aggregate scores from the official results file; no results licence asserted. The evaluation scaffold agreement is not presented as a licence for these scores · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · OpenEvals/leaderboard-data, MIT (licence) · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · Speakleash community evaluation of INCLUDE-base-44 (Romanou et al., arXiv:2411.19799). Public results.csv; no results licence stated. · Maheshwari et al., IndicParam, arXiv:2512.00333v3. Cited numeric scores under the owner's 2026-10-10 task-only restriction scope decision; no results licence established. Tasks, prompts and generations excluded. · Vasselli, Martínez Peguero, Hudi, Sakajo and Watanabe. Measuring Linguistic Competence of LLMs on Indigenous Languages of the Americas. EACL 2026, ©2026 ACL, CC BY 4.0. Numeric/protocol extract from Tables 1–4; random reference rows omitted. (licence) · JudgeBench, Sijun Tan et al., ScalerLab · M-IFEval: Dussolle, Cardeña Díaz, Sato and Devine (Lightblue), arXiv:2502.04688. README leaderboard, repository licensed Apache-2.0. (licence) · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · OpenLLM French Leaderboard (le-leadboard), Mohamad Alhajar and Alexandre Lavallée; publisher-normalized public result files; results licence not stated (the Space's Apache-2.0 covers code) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · Phare (Giskard), CC BY 4.0 (licence) · NVIDIA RULER, Hsieh et al. Official README numeric table; no separate results licence asserted. · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · Shaberi v2.1, Shisa.AI, Apache-2.0. GPT-5.1-judge scores only; judges are not comparable. (licence) · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · Swallow LLM Leaderboard v2, Swallow LLM team (Institute of Science Tokyo). Contents CC BY 4.0; Japanese post-trained task scores on the source's 0..1 scale. (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted.

Also known as: @cf/meta/llama-3.1-8b-instruct-fp8, aihubmix-llama-3-1-8b-instruct, cloudflare/@cf/meta/llama-3.1-8b-instruct-fp8, databricks/databricks-meta-llama-3-1-8b-instruct, deepinfra/meta-llama/meta-llama-3.1-8b-instruct, fireworks_ai/accounts/fireworks/models/llama-v3p1-8b-instruct, hyperbolic/meta-llama/meta-llama-3.1-8b-instruct, lambda_ai/llama3.1-8b-instruct, llama-3-1-8b-instruct, llama-v3p1-8b-instruct, meta-llama-3-1-8b-instruct, meta-llama-3-1-8b-instruct-fp8, meta-llama-3.1-8b-instruct, meta-llama-3.1-8b-instruct-fp8, meta-llama/llama-3.1-8b-instruct, meta-llama/llama-3.1-8b-instruct-bf16, meta-llama/llama-3.1-8b-instruct:free, meta-llama/meta-llama-3.1-8b-instruct, meta/llama-3.1-8b-instruct, nebius/meta-llama/meta-llama-3.1-8b-instruct, nim/meta/llama-3.1-8b-instruct, novita/meta-llama/llama-3.1-8b-instruct, nscale/meta-llama/llama-3.1-8b-instruct, oci/meta.llama-3.1-8b-instruct, ovhcloud/llama-3.1-8b-instruct, perplexity/llama-3.1-8b-instruct, vertex_ai/meta/llama-3.1-8b-instruct-maas, wandb/meta-llama/llama-3.1-8b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works