Evidence and sources
llminfo IQ 134.6, ranked among chat models. From 6 benchmarks. A fair amount of data behind it.How llminfo IQ is computedCoding IQ 110.3, 95% interval 90–131. From 3 benchmark families across 2 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (38.3). Costs more per task than its benchmark results predict. From 1 benchmark with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTypical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.Median 187,695 output tokens per task with reasoning off.How the Yap score works
Source: Models.dev dataPrimary data from Models.dev
Advantages and trade-offs
Compared with 10 chat models, picked mainly by popularity and IQ
Advantages
Trade-offs
No open weights
The weights aren't public, so you can't run it yourself.
Input & output
from the model's typeText
Text
Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works