Skip to content

Google · Chat

Gemini 2.0 Flash

Google 🇺🇸ChatGemini family
llminfo IQ
116.1
Maker's price
$0.175 blended / 1M
Max context
1M
Listings
3

Evidence and sources

llminfo IQ 116.1, ranked among chat models. From 211 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 84.6, 95% interval 71–98. From 3 benchmark families across 3 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.How Coding IQ is computedFair value (52.1). Costs per task about what its benchmark results predict. From 14 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksMaker HQ: US (according to Google's own website)
Sources: GenAI Prices data, FlowDot dataPrimary data from GenAI Prices from FlowDot: name

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Listings

 Googlegemini-2.0-flash-001Source: Portkey Models dataNot published by the provider$0.10$0.40
 Flowdotgoogle/gemini-2.0-flash-001Source: FlowDot data1M$0.10$0.40
 OpenRoutergemini-2.0-flash-001Source: GenAI Prices dataNot published by the provider$0.10cache read $0.025$0.40cache write $0.1833

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Speech

AHELM23 related benchmarks · 95 results
MuTox - EM
Source: AHELM (HELM Audio) data · Feb 2025
By language
Language not reported
Show 60 more resultsHide 60 results
CoVost-2 - BLEU
Source: AHELM (HELM Audio) data · Feb 2025
By source_language · target_language: English
Setting not stated
FLEURS - WER
Source: AHELM (HELM Audio) data · Feb 2025
By language
Language not reported
FLEURS Fairness - WER
Source: AHELM (HELM Audio) data · Feb 2025
By gender
Gender not reported
LibriSpeech Fairness - WER
Source: AHELM (HELM Audio) data · Feb 2025
By gender
Gender not reported
Multilingual Librispeech - WER
Source: AHELM (HELM Audio) data · Feb 2025
By language
Language not reported
MUStARD - EM
Source: AHELM (HELM Audio) data · Feb 2025
PARADE - EM
Source: AHELM (HELM Audio) data · Feb 2025
By subset · voice: female
By subset · voice: male
Setting not stated
Robust Speech Bench - WER
Source: AHELM (HELM Audio) data · Feb 2025
By subject
Subject not reported
By level · subject: librispeech_env_noise
By level · subject: librispeech_gnoise
VocalSound - PEM
Source: AHELM (HELM Audio) data · Feb 2025
By sound
Sound not reported
Voice Jailbreak Attacks Against GPT-4o - Refusal rate for safety
Source: AHELM (HELM Audio) data · Feb 2025
By subset
Subset not reported
VoxCeleb2 - EM
Source: AHELM (HELM Audio) data · Feb 2025

Safety

AHELM5 related benchmarks · 13 results
Air-Bench Chat (knowledge subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · Feb 2025
By subject
Subject not reported
Air-Bench Chat (reasoning subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · Feb 2025
By subject
Subject not reported
Air-Bench Foundation - EM
Source: AHELM (HELM Audio) data · Feb 2025
By subject
Subject not reported
HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score

Long context

Multilingual

Reasoning

Coding

Math

General

Science

Factuality

FaithJudge Hallucination RateSource: FaithJudge data

Agentic

Knowledge

Vision

Human preference

Instruction following

Other

Data credits: AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · BullshitBench by Peter Gostev, MIT (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted.

Around the web

Also known as: google/gemini-2.0-flash-001

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works