Skip to content

Google · Chat

gemma-7b

Google 🇺🇸ChatGemini family
llminfo IQ
93.3
Market median price
$0.20 blended / 1M
Max context
8K
Listings
3

Evidence and sources

🤗 google/gemma-7bllminfo IQ 93.3, ranked among chat models. From 94 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 21 Feb 2024Maker HQ: US (according to Google's own website)
Sources: GenAI Prices data, llminfo researchPrimary data from GenAI Prices from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 Fireworks AIfireworks_ai/accounts/fireworks/models/gemma-7bSource: LiteLLM data8K$0.20$0.20
 Together AIgoogle/gemma-7bSource: GenAI Prices dataNot published by the provider$0.20$0.20

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Knowledge

HELM59 related benchmarks · 59 results
Show 53 more resultsHide 53 results

Reasoning

Coding

General

Math

Science

Factuality

Instruction following

Multilingual

Other

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)

Around the web

Also known as: fireworks_ai/accounts/fireworks/models/gemma-7b, google/gemma-7b, snowflake/gemma-7b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works