Skip to content

Meta · Chat

Meta Llama 3 8b

Meta 🇺🇸ChatLlama family

Newer version: Llama 3.1 8B. We compared release dates and version names in our catalogue.

From Replicate's listing:
Base version of Llama 3, an 8 billion parameter language model from Meta.
llminfo IQ
94.7
Market median price
$0.10 blended / 1M
Max context
8K
Listings
8

Evidence and sources

llminfo IQ 94.7, ranked among chat models. From 88 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 18 Apr 2024Maker HQ: US (according to Meta's own website)
Sources: Helicone Costs data, Replicate data docs, llminfo researchPrimary data from Helicone Costs from Replicate: name, description from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 Aihubmixmeta-llama-3-8bSource: AIHubMix data docsNot published by the provider$0.548$0.548
 Replicatemeta/meta-llama-3-8bSources: LiteLLM data, Replicate data docs8K$0.05$0.25
 Vercelmeta/llama-3-8bSource: Helicone Costs dataNot published by the provider$0.05$0.08
 Fireworks AIfireworks_ai/accounts/fireworks/models/llama-v3-8bSource: LiteLLM data8K$0.20$0.20
 Vercel AI Gatewayvercel_ai_gateway/meta/llama-3-8bSource: LiteLLM data8K$0.05$0.08

3 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Knowledge

HELM59 related benchmarks · 59 results
Show 53 more resultsHide 53 results

Multilingual

Reasoning

General

Math

Science

Factuality

Instruction following

Other

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Hugging Face official benchmark leaderboards; licence varies by benchmark · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.

Also known as: fireworks_ai/accounts/fireworks/models/llama-v3-8b, llama3:8b, meta-llama-3-8b, meta/llama-3-8b, meta/meta-llama-3-8b, ollama/llama3:8b, replicate/meta/llama-3-8b, replicate/meta/meta-llama-3-8b, snowflake/llama3-8b, vercel_ai_gateway/meta/llama-3-8b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works