Skip to content

Google · Chat

Gemini 2.5 Pro Preview 05-06

Google 🇺🇸ChatGemini family
From Aihubmix's listing:
Integrated with Google's official search function.
llminfo IQ
127.2
Max context
1M
Listings
5

Evidence and sources

llminfo IQ 127.2, ranked among chat models. From 100 benchmarks. Plenty of data behind it.How llminfo IQ is computedGood value (59.8). Cheaper per task than its benchmark results predict. From 4 benchmarks with measured task costs. A fair amount of data behind it.How Value for money worksMaker HQ: US (according to Google's own website)
Sources: Helicone Costs data, FlowDot data, AIHubMix data docsPrimary data from Helicone Costs from FlowDot: name from AIHubMix: description

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Images
Audio
Video
Files
Text

Capabilities

Supported operations and provider-stated features

Reasoning

Listings

 Googlegemini-2.5-pro-preview-05-06Source: Portkey Models dataNot published by the provider$1.25>128k $2.50$10.00>128k $15.00
 Aihubmixgemini-2.5-pro-preview-05-06Source: AIHubMix data docs1M$1.25cache read $0.125$10.00
 Aihubmixgemini-2.5-pro-preview-05-06-search · searchSource: AIHubMix data docsNot published by the provider$1.25cache read $0.125$10.00
 Flowdotgoogle/gemini-2.5-pro-preview-05-06Source: FlowDot data1M$1.25$10.00
 OpenRoutergoogle/gemini-2.5-pro-preview-05-06Source: Helicone Costs dataNot published by the provider$1.25$10.00

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Speech

AHELM23 related benchmarks · 89 results
MuTox - EM
Source: AHELM (HELM Audio) data · May 2025
By language
Language not reported
Show 54 more resultsHide 54 results
CoVost-2 - BLEU
Source: AHELM (HELM Audio) data · May 2025
By source_language · target_language: English
Setting not stated
FLEURS - WER
Source: AHELM (HELM Audio) data · May 2025
By language
Language not reported
FLEURS Fairness - WER
Source: AHELM (HELM Audio) data · May 2025
By gender
Gender not reported
LibriSpeech Fairness - WER
Source: AHELM (HELM Audio) data · May 2025
By gender
Gender not reported
Multilingual Librispeech - WER
Source: AHELM (HELM Audio) data · May 2025
By language
Language not reported
MUStARD - EM
Source: AHELM (HELM Audio) data · May 2025
PARADE - EM
Source: AHELM (HELM Audio) data · May 2025
By subset · voice: female
By subset · voice: male
Setting not stated
Robust Speech Bench - WER
Source: AHELM (HELM Audio) data · May 2025
By level · subject: librispeech_env_noise
By level · subject: librispeech_gnoise
Setting not stated
VocalSound - PEM
Source: AHELM (HELM Audio) data · May 2025
By sound
Sound not reported
Voice Jailbreak Attacks Against GPT-4o - Refusal rate for safety
Source: AHELM (HELM Audio) data · May 2025
By subset
Subset not reported
VoxCeleb2 - EM
Source: AHELM (HELM Audio) data · May 2025

Safety

AHELM5 related benchmarks · 12 results
Air-Bench Chat (knowledge subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · May 2025
By subject
Subject not reported
Air-Bench Chat (reasoning subsets) - GPT-4o Judge Critique
Source: AHELM (HELM Audio) data · May 2025
By subject
Subject not reported
Air-Bench Foundation - EM
Source: AHELM (HELM Audio) data · May 2025
By subject
Subject not reported

Long context

Reasoning

Science

Agentic

Coding

General

Factuality

Math

Multilingual

Other

Data credits: Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · DABstep (Adyen), CC BY 4.0 (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence)

Around the web

Also known as: gemini-2.5-pro-preview-05-06-search, google/gemini-2.5-pro-preview-05-06

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works