Skip to content

Google · Chat

Gemini 2.0 Flash Experimental

Google 🇺🇸ChatGemini family
llminfo IQ
114.5
Market median price
$0.30 blended / 1M
Max context
1M
Listings
3

Evidence and sources

llminfo IQ 114.5, ranked among chat models. From 159 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 82.3, 95% interval 70–94. From 3 benchmark families across 3 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.How Coding IQ is computedGood value (68.2). Cheaper per task than its benchmark results predict. From 3 benchmarks with measured task costs. A fair amount of data behind it.How Value for money worksMaker HQ: US (according to Google's own website)
Sources: Helicone Costs data, FlowDot dataPrimary data from Helicone Costs from FlowDot: name

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ
We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Listings

 302aigemini-2.0-flash-expSource: 302.ai data1M$0.20$0.60
 Flowdotgoogle/gemini-2.0-flash-exp:free · freeSource: FlowDot data1M$0.00$0.00
 OpenRoutergoogle/gemini-2.0-flash-exp:free · freeSource: Helicone Costs dataNot published by the provider$0.00$0.00

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Speech

AHELM23 related benchmarks · 95 results
MuTox - EM
Source: AHELM (HELM Audio) data · Dec 2024
By language
Language not reported
Show 60 more resultsHide 60 results
CoVost-2 - BLEU
Source: AHELM (HELM Audio) data · Dec 2024
By source_language · target_language: English
Setting not stated
FLEURS - WER
Source: AHELM (HELM Audio) data · Dec 2024
By language
Language not reported
FLEURS Fairness - WER
Source: AHELM (HELM Audio) data · Dec 2024
By gender
Gender not reported
LibriSpeech Fairness - WER
Source: AHELM (HELM Audio) data · Dec 2024
By gender
Gender not reported
Multilingual Librispeech - WER
Source: AHELM (HELM Audio) data · Dec 2024
By language
Language not reported
MUStARD - EM
Source: AHELM (HELM Audio) data · Dec 2024
PARADE - EM
Source: AHELM (HELM Audio) data · Dec 2024
By subset · voice: female
By subset · voice: male
Setting not stated
Robust Speech Bench - WER
Source: AHELM (HELM Audio) data · Dec 2024
By subject
Subject not reported
By level · subject: librispeech_env_noise
By level · subject: librispeech_gnoise
VocalSound - PEM
Source: AHELM (HELM Audio) data · Dec 2024
By sound
Sound not reported
Voice Jailbreak Attacks Against GPT-4o - Refusal rate for safety
Source: AHELM (HELM Audio) data · Dec 2024
By subset
Subset not reported
VoxCeleb2 - EM
Source: AHELM (HELM Audio) data · Dec 2024

Knowledge

HELM59 related benchmarks · 59 results
Show 53 more resultsHide 53 results

Safety

AHELM5 related benchmarks · 13 results
Air-Bench Chat (knowledge subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · Dec 2024
By subject
Subject not reported
Air-Bench Chat (reasoning subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · Dec 2024
By subject
Subject not reported
Air-Bench Foundation - EM
Source: AHELM (HELM Audio) data · Dec 2024
By subject
Subject not reported

Image generation

RISEBenchSource: RISEBench data

Reasoning

Coding

General

Agentic

Math

Factuality

Multilingual

Science

Other

Data credits: AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)

Around the web

Also known as: google/gemini-2.0-flash-exp:free

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works