Skip to content

Google · Chat

Gemma 2 27B IT

Google 🇺🇸ChatGemini familyOpen weights. One of its sources says the weights are publicly available.

Newer version: Gemma 3 27B IT. We compared release dates and version names in our catalogue.

llminfo IQ
103.6
Maker's price
$0.65 blended / 1M
Max context
8K
Listings
14

Evidence and sources

🤗 google/gemma-2-27b-itllminfo IQ 103.6, ranked among chat models. From 120 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 75.7, 95% interval 65–86. From 4 benchmark families across 3 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedReleased 27 Jun 2024 Training-data cutoff, as its sources state it Maker HQ: US (according to Google's own website)
All rankings: #498 on OpenRouter this month #520 on OpenRouter today #524 on OpenRouter this weekSources: LMArena data, Models.dev data, AI/ML API data, OpenRouter data docs, llminfo researchPrimary data from LMArena from Models.dev: weights availability from AI/ML API: primary mode from OpenRouter: knowledge cutoff from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Open weights available

The weights are public. 2 of the 6 peers that say either way have open weights.

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 10 maker's prices.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

ReasoningFunction callingStructured output

Listings

 Googlegemma-2-27b-itSource: GenAI Prices dataNot published by the provider$0.65$0.65——
 Aihubmixgoogle/gemma-2-27b-itSource: AIHubMix data docsNot published by the provider$0.80$0.80——
 Flowdotgoogle/gemma-2-27b-itSource: FlowDot data8K$0.65$0.65——
 Hugging Facegoogle/gemma-2-27b-itSource: Models.dev data8K$0.65$0.65——
 Hugging FaceInference by Nextbitgoogle/gemma-2-27b-itSource: Hugging Face Inference Providers data8K$0.65$0.65——
 Kilogoogle/gemma-2-27b-itSources: Kilo AI Gateway data, Models.dev data8K$0.65$0.65——
 OpenRouterInference by Nextbitgoogle/gemma-2-27b-it · int4Source: OpenRouter data docs8K$0.65$0.6553.5487ms
 OpenRoutergoogle/gemma-2-27b-itSources: GenAI Prices data, Models.dev data, OpenRouter data docs8K$0.65$0.65——
 Aimlapigoogle/gemma-2-27b-itSource: Models.dev data8K$0.6877$0.6877——
 Nextbitgemma-2:27b-it · int4Source: NextBit data8K$0.65$0.65——
 Together AIgoogle/gemma-2-27b-itSource: Together AI data8K$0.80$0.80——

3 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Multilingual

Reasoning

ARC-CSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ARC-ESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
BoolQSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HellaSwagSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
PIQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Math

AGIEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
BIG-BenchSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GSM8KSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Coding

HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

TriviaQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

Instruction following

Other

Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average

Data credits: Data by LLM Stats · LMArena, CC BY 4.0 (licence) · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.

Also known as: google/gemma-2-27b-it

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works