Skip to content

Google · Chat

gemma2-27b

Google 🇺🇸ChatGemini family
llminfo IQ
100.7
Listings
1
Providers
1

Evidence and sources

llminfo IQ 100.7, ranked among chat models. From 91 benchmarks. Plenty of data behind it.How llminfo IQ is computedMaker HQ: US (according to Google's own website)
All rankings: #23 in Google Trends interest this weekSource: FlowDot dataPrimary data from FlowDot

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

from the model's type
Text
Text

Listings

We don't have any priced listings for this model yet.

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Knowledge

HELM MMLU56 related benchmarks · 56 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Anatomy - EM
Abstract Algebra - EM
Astronomy - EM
Business Ethics - EM
Show 52 more benchmarksHide 52 benchmarks
BenchmarkScore
Clinical Knowledge - EM
College Biology - EM
College Chemistry - EM
College Computer Science - EM
College Mathematics - EM
College Medicine - EM
College Physics - EM
Computer Security - EM
Conceptual Physics - EM
Econometrics - EM
Electrical Engineering - EM
Elementary Mathematics - EM
High School Biology - EM
High School Chemistry - EM
High School Computer Science - EM
High School European History - EM
High School Geography - EM
High School Government And Politics - EM
High School Macroeconomics - EM
High School Mathematics - EM
High School Microeconomics - EM
High School Physics - EM
High School Psychology - EM
High School Statistics - EM
High School US History - EM
High School World History - EM
Human Aging - EM
Human Sexuality - EM
International Law - EM
Jurisprudence - EM
Logical Fallacies - EM
Machine Learning - EM
Management - EM
Marketing - EM
Medical Genetics - EM
Miscellaneous - EM
MMLU All Subjects - EM
Moral Disputes - EM
Moral Scenarios - EM
Nutrition - EM
Philosophy - EM
Prehistory - EM
Professional Accounting - EM
Professional Law - EM
Professional Medicine - EM
Professional Psychology - EM
Public Relations - EM
Security Studies - EM
Sociology - EM
Us Foreign Policy - EM
Virology - EM
World Religions - EM

General

Multilingual

SeaLLMs SeaExamSource: SeaLLMs Leaderboard for SEA Languages data docs

Reasoning

Factuality

Agentic

Coding

Instruction following

Math

Science

Other

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Open Arabic LLM Leaderboard (OALL), Apache-2.0 (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated.

Also known as: gemma2:27b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works