Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Coding IQ 84.9, 95% interval 76β94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05
$0.60
βNot published by the provider
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
113.2
From 223 benchmarks. Plenty of data behind it.
86Β Β±8
Coding IQ 85.6, 95% interval 77β94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08
$0.70
βNot published by the provider
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76β101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04
$0.30
βNot published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.