Evidence and sources
Advantages and trade-offs
Compared with 10 chat models, picked mainly by popularity and IQ
Trade-offs
Input & output
from the model's typeListings
| —Not published by the provider | $1.25>128k $2.50 | $5.00>128k $10.00 |
Benchmarks
Named effort levels run from lowest to highest. Select a result to see its source details.
Speech
Show 60 more resultsHide 60 results
Safety
| Benchmark | Score |
|---|---|
| Privacy | |
| #1: Confidentiality | |
| #2: Integrity | |
| #3: Availability |
Show 55 more benchmarksHide 55 benchmarks
Knowledge
Show 54 more resultsHide 54 results
Coding
Agentic
Math
Vision
Reasoning
General
Science
Multilingual
Factuality
Human preference
Instruction following
OCR
Other
Data credits: AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · OpenVLM Leaderboard (OpenCompass / VLMEvalKit), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)
Around the web
- HN discussion 49828796Discussion
news.ycombinator.com
- HN discussion 49872041Discussion
news.ycombinator.com
- HN discussion 49914093Discussion
news.ycombinator.com
Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works