Skip to content

Google · Chat

Gemma 2 2B IT

Google 🇺🇸ChatGemini family
llminfo IQ
94.5
Market median price
$0.03 blended / 1M
Max context
8K
Listings
1

Evidence and sources

🤗 google/gemma-2-2b-itllminfo IQ 94.5, ranked among chat models. From 80 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 31 Jul 2024Maker HQ: US (according to Google's own website)
Sources: LMArena data, llminfo researchPrimary data from LMArena from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 3 market median prices.

Input & output

from the model's type
Text
Text

Listings

 Hugging FaceInference by Nebius AI Studiogoogle/gemma-2-2b-itSource: GenAI Prices data8K$0.02$0.06

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Arena ELO26 related benchmarks · 26 results
WildBench6 related benchmarks · 6 results
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro

General

Multilingual

Math

Coding

Instruction following

Reasoning

Knowledge

Science

Other

Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: LMArena, CC BY 4.0 (licence) · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · WildBench, Allen Institute for AI

Also known as: google/gemma-2-2b-it

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works