Skip to content

Google · Chat

gemma-2-9b

Google 🇺🇸ChatGemini family
llminfo IQ
100.1
Market median price
$0.20 blended / 1M
Max context
8K
Listings
3

Evidence and sources

🤗 google/gemma-2-9bllminfo IQ 100.1, ranked among chat models. From 86 benchmarks. Plenty of data behind it.How llminfo IQ is computedGood value (60.0). Cheaper per task than its benchmark results predict. From 1 benchmark with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksReleased 27 Jun 2024Maker HQ: US (according to Google's own website)
Sources: Helicone Costs data, llminfo researchPrimary data from Helicone Costs from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Images
Text

Capabilities

Supported operations and provider-stated features

VisionFunction calling

Listings

 Vercelgoogle/gemma-2-9bSource: Helicone Costs dataNot published by the provider$0.20$0.20
 Vercel AI Gatewayvercel_ai_gateway/google/gemma-2-9bSource: LiteLLM data8K$0.20$0.20

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Knowledge

HELM MMLU56 related benchmarks · 56 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Anatomy - EM
Abstract Algebra - EM
Astronomy - EM
Business Ethics - EM
Show 52 more benchmarksHide 52 benchmarks
BenchmarkScore
Clinical Knowledge - EM
College Biology - EM
College Chemistry - EM
College Computer Science - EM
College Mathematics - EM
College Medicine - EM
College Physics - EM
Computer Security - EM
Conceptual Physics - EM
Econometrics - EM
Electrical Engineering - EM
Elementary Mathematics - EM
High School Biology - EM
High School Chemistry - EM
High School Computer Science - EM
High School European History - EM
High School Geography - EM
High School Government And Politics - EM
High School Macroeconomics - EM
High School Mathematics - EM
High School Microeconomics - EM
High School Physics - EM
High School Psychology - EM
High School Statistics - EM
High School US History - EM
High School World History - EM
Human Aging - EM
Human Sexuality - EM
International Law - EM
Jurisprudence - EM
Logical Fallacies - EM
Machine Learning - EM
Management - EM
Marketing - EM
Medical Genetics - EM
Miscellaneous - EM
MMLU All Subjects - EM
Moral Disputes - EM
Moral Scenarios - EM
Nutrition - EM
Philosophy - EM
Prehistory - EM
Professional Accounting - EM
Professional Law - EM
Professional Medicine - EM
Professional Psychology - EM
Public Relations - EM
Security Studies - EM
Sociology - EM
Us Foreign Policy - EM
Virology - EM
World Religions - EM

Multilingual

SeaLLMs SeaExamSource: SeaLLMs Leaderboard for SEA Languages data docs

Reasoning

Math

Instruction following

Science

Factuality

General

Other

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Hugging Face official benchmark leaderboards; licence varies by benchmark · OpenLLM French Leaderboard (le-leadboard), Mohamad Alhajar and Alexandre Lavallée; publisher-normalized public result files; results licence not stated (the Space's Apache-2.0 covers code) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence)

Around the web

Also known as: gemma2:9b, google/gemma-2-9b, vercel_ai_gateway/google/gemma-2-9b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works