Skip to content

Meta · Chat

Llama-2-7b-chat-hf

Meta 🇺🇸ChatLlama family
llminfo IQ
77.3
Market median price
$0.15 blended / 1M
Max context
4K
Listings
2

Evidence and sources

🤗 meta-llama/Llama-2-7b-chat-hfllminfo IQ 77.3, ranked among chat models. From 128 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 18 Jul 2023Maker HQ: US (according to Meta's own website)
All rankings: #4 in Google Trends interest this weekSources: Together AI data, llminfo researchPrimary data from Together AI from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 Anyscaleanyscale/meta-llama/Llama-2-7b-chat-hfSource: LiteLLM data4K$0.15$0.15
 Together AImeta-llama/Llama-2-7b-chat-hfSources: GenAI Prices data, Together AI data4K$0.20$0.20

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

WildBench26 related benchmarks · 26 results
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
gpt4t_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.task_macro.K: -1, gpt-4-turbo-2024-04-09
Show 20 more resultsHide 20 results
haiku_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Creative Tasks.K: -1, claude-3-haiku-20240307
haiku_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Information/Advice seeking.K=-1, claude-3-haiku-20240307
haiku_reward.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.K: -1, claude-3-haiku-20240307
haiku_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Planning & Reasoning.K=-1, claude-3-haiku-20240307
haiku_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.task_macro.K: -1, claude-3-haiku-20240307
llama_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Creative Tasks.K: -1, Llama-2-70b-chat-hf
llama_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Information/Advice seeking.K=-1, Llama-2-70b-chat-hf
llama_reward.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.K: -1, Llama-2-70b-chat-hf
llama_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Planning & Reasoning.K=-1, Llama-2-70b-chat-hf
llama_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.task_macro.K: -1, Llama-2-70b-chat-hf
mixture_of_rewards.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
task_macro_reward.K=-1
Source: WildBench direct data
allenai/WildBench, task_macro_reward.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro

Factuality

HF Hallucinations20 related benchmarks · 20 results
SQuADv2, EM
Source: HF Hallucinations aggregate matrix
clustermap_all/SQuADv2, EM
CNN/DM, BERT-P
Source: HF Hallucinations aggregate matrix
clustermap_all/CNN/DM, BERT-P
CNN/DM, factKB
Source: HF Hallucinations aggregate matrix
clustermap_all/CNN/DM, factKB
CNN/DM, ROUGE-L
Source: HF Hallucinations aggregate matrix
clustermap_all/CNN/DM, ROUGE-L
HaluEval Dialog, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval Dialog, Accuracy
HaluEval Dialog, EM
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval Dialog, EM
Show 14 more resultsHide 14 results
HaluEval QA, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval QA, Accuracy
HaluEval QA, EM
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval QA, EM
HaluEval Summarization, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval Summarization, Accuracy
HaluEval Summarization, EM
Source: HF Hallucinations aggregate matrix
clustermap_all/HaluEval Summarization, EM
MemoTrap, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/MemoTrap, Accuracy
NQ (8-shot), EM
Source: HF Hallucinations aggregate matrix
clustermap_all/NQ (8-shot), EM
RACE, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/RACE, Accuracy
TriviaQA (8-shot), EM
Source: HF Hallucinations aggregate matrix
clustermap_all/TriviaQA (8-shot), EM
True-False, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/True-False, Accuracy
TruthfulQA MC1, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/TruthfulQA MC1, Accuracy
TruthfulQA MC2, Accuracy
Source: HF Hallucinations aggregate matrix
clustermap_all/TruthfulQA MC2, Accuracy
XSum, BERT-P
Source: HF Hallucinations aggregate matrix
clustermap_all/XSum, BERT-P
XSum, factKB
Source: HF Hallucinations aggregate matrix
clustermap_all/XSum, factKB
XSum, ROUGE-L
Source: HF Hallucinations aggregate matrix
clustermap_all/XSum, ROUGE-L

Instruction following

Science

ChemBench10 related benchmarks · 10 results
ChemBench
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Analytical Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Chemical Preference
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
General Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Inorganic Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Materials Science
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Show 4 more resultsHide 4 results
Organic Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Physical Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Technical Chemistry
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893
Toxicity and Safety
Source: ChemBench verified leaderboard data docs
Llama-2-7b-chat-hf -base-1741273893

Math

WildBench5 related benchmarks · 5 results
WB_score.Math & Data Analysis
Source: WildBench direct data
allenai/WildBench, WB_score.Math & Data Analysis
gpt4t_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Math & Data Analysis.K=-1, claude-3-haiku-20240307
llama_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Math & Data Analysis.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

Coding

WildBench5 related benchmarks · 5 results
WB_score.Coding & Debugging
Source: WildBench direct data
allenai/WildBench, WB_score.Coding & Debugging
gpt4t_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Coding & Debugging.K=-1, claude-3-haiku-20240307
llama_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Coding & Debugging.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf

Reasoning

Knowledge

Long context

Other

FinBen61 related benchmarks · 61 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 55 more resultsHide 55 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
ECTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BartScore
ECTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BertScore
ECTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, Rouge-1
EDTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BartScore
EDTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BertScore
EDTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, Rouge-1
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, ACC
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, ACC
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, ACC
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, ACC
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, ACC
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1

Data credits: ChemBench leaderboard, Jablonka group / lamalab-org. Public verified numeric result summaries; results licence not separately stated. · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Hallucinations Leaderboard, Apache-2.0. Publisher-selected archived score matrix; native normalized fractions. (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · NVIDIA RULER, Hsieh et al. Official README numeric table; no separate results licence asserted. · WildBench, Allen Institute for AI

Around the web

  • What Is Llama 2? | IBM
    Llama 2 is a family of pre-trained and fine-tuned large language models (LLMs) released by …Llama 2 is a family of pre-trained and fine-tuned large language models (LLMs) released by Meta AI in 2023. Released free of charge for research and commercial use, Llama 2 AI models are capable of a…

    ibm.com

  • Llama 2 Online - Next-Gen Large Language Model by Meta
    Workflow Home Llama 3 Llama 3.1 Advantages Terms Privacy 🇺🇸 English Open menu Experience the …Workflow Home Llama 3 Llama 3.1 Advantages Terms Privacy 🇺🇸 English Open menu Experience the Power of Llama 2 Discover the Capabilities of Meta's Innovative Llama 2, Pushing Boundaries in Large Lan…

    llama2.space

  • Meta Open Sources New AI Model Llama 2 - InfoQ
    According to Meta, Llama 2 has been trained on over 40% more data compared to …According to Meta, Llama 2 has been trained on over 40% more data compared to the previous Llama version and outperforms other language models on reasoning and knowledge tests. Percy Liang, director …

    infoq.com

  • llama-models/models/llama2/MODEL_CARD.md at main · meta-llama/llama-models · GitHub

    https://github.com/meta-llama/llama-models/blob/main/models/llama2/MODEL_CARD.md Repository: meta-llama/llama-models Path: models/llama2/MODEL_CARD.md Ref: main Lines: 100 Model Details · Training Da…

    github.com

  • IBM Plans to Make Llama 2 Available within its Watsonx AI and Data Platform
    All press releases IBM Plans to Make Llama 2 Available within its Watsonx AI and …All press releases IBM Plans to Make Llama 2 Available within its Watsonx AI and Data Platform Aug 9, 2023 * * * * ARMONK, N.Y. , Aug. 9, 2023 / PRNewswire / -- As part of the continued roll-out of o…

    newsroom.ibm.com

  • Llama 2 · Hugging Face
    Llama 2 is a family of large language models, Llama 2 and Llama 2-Chat, available …Llama 2 is a family of large language models, Llama 2 and Llama 2-Chat, available in 7B, 13B, and 70B parameters. The Llama 2 model mostly keeps the same architecture as Llama, but it is pretrained o…

    huggingface.co

  • Llama 2 · Hugging Face
    Llama 2 is a family of large language models, Llama 2 and Llama 2-Chat, available …Llama 2 is a family of large language models, Llama 2 and Llama 2-Chat, available in 7B, 13B, and 70B parameters. The Llama 2 model mostly keeps the same architecture as Llama , but it is pretrained …

    huggingface.co

  • llama/MODEL_CARD.md at main
    llama/MODEL_CARD.md at main Llama 2 family of models. Token counts refer to pretraining data only. …llama/MODEL_CARD.md at main Llama 2 family of models. Token counts refer to pretraining data only. All models are trained with a global batch-size of 4M tokens. The 70B version uses

    github.com

  • Introducing LLaMA: A foundational, 65-billion-parameter language model
    Meta Products AI Research Resources About AI Developers Try Meta AI Research Introducing LLaMA: A …Meta Products AI Research Resources About AI Developers Try Meta AI Research Introducing LLaMA: A foundational, 65-billion-parameter large language model February 24, 2023 Share on Facebook Share on …

    ai.meta.com

  • meta/llama-2-13b-chat | Run with an API on Replicate
    image: https://og-api.replicateassets.com/api/models/meta/llama-2-13b-chat description: A 13 billion parameter language model from Meta, fine tuned for chat …image: https://og-api.replicateassets.com/api/models/meta/llama-2-13b-chat description: A 13 billion parameter language model from Meta, fine tuned for chat completions Playground API Examples README…

    replicate.com

Also known as: anyscale/meta-llama/llama-2-7b-chat-hf, meta-llama/llama-2-7b-chat-hf

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works