Skip to content

Google · Chat

gemini-1.0-pro

Google 🇺🇸ChatGemini family

Newer version: Gemini 2.5 Pro. Our catalogue has no release date for gemini-1.0-pro. We compared the version names in our catalogue.

llminfo IQ
89.0
Listings
1
Providers
1

Evidence and sources

llminfo IQ 89.0, ranked among chat models. From 87 benchmarks. Plenty of data behind it.How llminfo IQ is computedMaker HQ: US (according to Google's own website)
Source: Helicone Costs dataPrimary data from Helicone Costs

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

from the model's type
Text
Text

Listings

 Googlegemini-1.0-proSource: Helicone Costs dataNot published by the provider$0.125$0.375

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Vision

Math

OCR

Science

Reasoning

EgoSchemaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Multilingual

Speech

Other

FinBen52 related benchmarks · 52 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 46 more resultsHide 46 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
ECTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BartScore
ECTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, BertScore
ECTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, ECTSUM, Rouge-1
EDTSUM BartScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BartScore
EDTSUM BertScore
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, BertScore
EDTSUM Rouge-1
Source: TheFinAI public numeric results
published-demo-leaderboard, EDTSUM, Rouge-1
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FinTrade SR
Source: TheFinAI public numeric results
published-demo-leaderboard, FinTrade, SR
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE

Data credits: OpenVLM Leaderboard (OpenCompass / VLMEvalKit), Apache-2.0 (licence) · Data by LLM Stats · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.

Around the web

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works