Skip to content

Google · Chat

Gemini 1.5 Flash-8B

Google 🇺🇸ChatGemini family
llminfo IQ
106.1
Max context
1M
Listings
3

Evidence and sources

llminfo IQ 106.1, ranked among chat models. From 50 benchmarks. Plenty of data behind it.How llminfo IQ is computedMaker HQ: US (according to Google's own website)
All rankings: #28 in Bluesky discussions this weekSource: LMArena dataPrimary data from LMArena

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

from the model's type
Text
Text

Listings

 Googlegemini-flash-1.5-8bSource: GenAI Prices data1M$0.0375>128k $0.075cache read $0.01$0.15>128k $0.30
 Googlegemini-1.5-flash-8b-latest · latestSource: Portkey Models dataNot published by the provider$0.0375>128k $0.075$0.15>128k $0.30
 OpenRoutergemini-flash-1.5-8bSource: GenAI Prices dataNot published by the provider$0.0375cache read $0.01$0.15cache write $0.0583

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Math

MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MathVistaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Vibe-EvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Video-MMESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Reasoning

MRCRSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Coding

Instruction following

Knowledge

MMLU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Multilingual

WMT23Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Safety

XSTestSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Speech

FLEURSSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

Data credits: LMArena, CC BY 4.0 (licence) · Data by LLM Stats

Around the web

Also known as: gemini-1.5-flash-8b, gemini-1.5-flash-8b-latest, google/gemini-flash-1.5-8b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works