Skip to content

Listings

All listings: Llmgateway

Every listing for the models on page 7 of 13 of Llmgateway, including each model's other versions and routes. Back to Llmgateway

Sold by Llmgateway

64 listings on this page sold by Llmgateway.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.57$2.30256K
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Moonshot-Kimi-K2-Instruct
Inference by Alibaba Cloud
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.574$2.294Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
moonshotai/kimi-k2-instruct
Inference by Groq
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$1.00cache read $0.50$3.00Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
kimi-k2-0905-preview
Inference by Moonshot AI
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.60cache read $0.15$2.50Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
moonshotai/Kimi-K2-Instruct
Inference by Nebius AI Studio
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.50$2.40Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
moonshotai/kimi-k2-instruct
Inference by Novita AI
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.57$2.30Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Codestral 25.01
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
codestral-2508 Β· 2508
116.6
From 10 benchmarks. A fair amount of data behind it.
Not enough data yet$0.30$0.90256K
37.8
Poor value (37.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Codestral 25.01
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
codestral-2508 Β· 2508
Inference by Mistral AI
116.6
From 10 benchmarks. A fair amount of data behind it.
Not enough data yet$0.30$0.90Not published by the provider
37.8
Poor value (37.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Qwen Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
116.4
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$0.40cache read $0.08$1.20cache write $0.50131K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen-plus-latest Β· latest
116.4
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$0.40cache read $0.08$1.20cache write $0.501M
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
116.4
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$0.40cache read $0.08$1.20cache write $0.50Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen-plus-latest Β· latest
Inference by Alibaba Cloud
116.4
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$0.40cache read $0.08$1.20cache write $0.50Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GLM 4.5V
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
115.8
From 62 benchmarks. A fair amount of data behind it.
Not enough data yet$0.60cache read $0.11$1.80128K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GLM 4.5V
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
115.8
From 62 benchmarks. A fair amount of data behind it.
Not enough data yet$0.60cache read $0.11$1.80Not published by the provider
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GLM 4.5V
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Z.ai
115.8
From 62 benchmarks. A fair amount of data behind it.
Not enough data yet$0.60cache read $0.11$1.80Not published by the provider
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Gemini 3.1 Flash Image
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
115.7
From 40 benchmarks. A fair amount of data behind it.
Not enough data yet$0.50$3.00131KNot enough data yetNot measuredNot measured
Gemini 3.1 Flash Image
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
115.7
From 40 benchmarks. A fair amount of data behind it.
Not enough data yet$0.50$3.00Not published by the providerNot enough data yetNot measuredNot measured
Ministral 14B
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
ministral-14b-2512 Β· 2512
115.6
From 33 benchmarks. A fair amount of data behind it.
Not enough data yet$0.20$0.20262KNot enough data yetNot measuredNot measured
Ministral 14B
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
ministral-14b-2512 Β· 2512
Inference by Mistral AI
115.6
From 33 benchmarks. A fair amount of data behind it.
Not enough data yet$0.20$0.20Not published by the providerNot enough data yetNot measuredNot measured
Qwen3 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
115.6
From 234 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$0.8741K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Cerebras
115.6
From 234 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$0.80Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
115.6
From 234 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Inference by Microsoft Azure
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.60Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Inference by OpenAI
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.60Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Inference by OpenAI
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium 3.5
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
115.3
From 173 benchmarks. Plenty of data behind it.
99Β Β±15
Coding IQ 98.6, 95% interval 84–114. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50$7.50262K
12.0
Poor value (12.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium 3.5
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Inference by Mistral AI
115.3
From 173 benchmarks. Plenty of data behind it.
99Β Β±15
Coding IQ 98.6, 95% interval 84–114. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50$7.50Not published by the provider
12.0
Poor value (12.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro TTS
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gemini-2.5-pro-preview-tts
β‰ˆ 115
From 16 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.00$20.008KNot enough data yetNot measuredNot measured
Gemini 2.5 Pro TTS
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gemini-2.5-pro-preview-tts
Inference by Google
β‰ˆ 115
From 16 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.00$20.00Not published by the providerNot enough data yetNot measuredNot measured
Qwen3 30B A3B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
114.4
From 142 benchmarks. Plenty of data behind it.
90Β Β±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.095$0.28533K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
114.4
From 142 benchmarks. Plenty of data behind it.
90Β Β±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Pixtral Large
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
pixtral-large-2502 Β· 2502
114.2
From 15 benchmarks. Plenty of data behind it.
Not enough data yet$2.00$6.00131K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Pixtral Large
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistral.pixtral-large-2502-v1:0 Β· 2502
Inference by Amazon Web Services
114.2
From 15 benchmarks. Plenty of data behind it.
Not enough data yet$2.00$6.00Not published by the provider
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
β‰ˆ 114
From 38 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”2KNot enough data yetNot measuredNot measured
Qwen3 14B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
114.1
From 210 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.076$0.22833K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Nebius AI Studio
114.1
From 210 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.24Not published by the provider
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
113.2
From 223 benchmarks. Plenty of data behind it.
86Β Β±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.15262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
113.2
From 223 benchmarks. Plenty of data behind it.
86Β Β±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.15Not published by the provider
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax Text 01
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
113.1
From 8 benchmarks. A fair amount of data behind it.
Not enough data yet$0.20$1.101MNot enough data yetNot measuredNot measured
MiniMax Text 01
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by MiniMax
113.1
From 8 benchmarks. A fair amount of data behind it.
Not enough data yet$0.20$1.10Not published by the providerNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”5KNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
image-1k
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”5KNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
image-2k
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”5KNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
image-1k
Inference by Alibaba Cloud
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Qwen Image 3.0 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
image-2k
Inference by Alibaba Cloud
β‰ˆ 113
From 32 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Llama 4 Maverick
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
llama-4-maverick-17b-instruct
111.8
From 350 benchmarks. Plenty of data behind it.
78Β Β±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.27$0.851M
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 Β±9
Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Maverick
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta.llama4-maverick-17b-instruct-v1:0
Inference by Amazon Web Services
111.8
From 350 benchmarks. Plenty of data behind it.
78Β Β±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.24$0.97Not published by the provider
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 Β±9
Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Maverick
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/llama-4-maverick-17b-128e-instruct-fp8
Inference by Novita AI
111.8
From 350 benchmarks. Plenty of data behind it.
78Β Β±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.27$0.85Not published by the provider
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 Β±9
Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen Max
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
111.6
From 56 benchmarks. Plenty of data behind it.
β‰ˆ 82Β Β±14
Coding IQ 81.7, 95% interval 68–95. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.60$6.4033K
42.6
Poor value (42.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen Max
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
111.6
From 56 benchmarks. Plenty of data behind it.
β‰ˆ 82Β Β±14
Coding IQ 81.7, 95% interval 68–95. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.60$6.40Not published by the provider
42.6
Poor value (42.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
qwen3-vl-30b
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen3-vl-30b-a3b-instruct
111.5
From 81 benchmarks. Plenty of data behind it.
Not enough data yet$0.15$0.60262K
45.6
Poor value (45.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
qwen3-vl-30b
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Qwen/Qwen3-VL-30B-A3B-Instruct
Inference by DeepInfra
111.5
From 81 benchmarks. Plenty of data behind it.
Not enough data yet$0.15$0.60Not published by the provider
45.6
Poor value (45.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
qwen3-vl-30b
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-vl-30b-a3b-instruct
Inference by Novita AI
111.5
From 81 benchmarks. Plenty of data behind it.
Not enough data yet$0.20$0.70Not published by the provider
45.6
Poor value (45.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Text Embedding 004
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
111.4
From 43 benchmarks. Plenty of data behind it.
Not enough data yet$0.025β€”2KNot enough data yetNot measuredNot measured
Text Embedding 004
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
111.4
From 43 benchmarks. Plenty of data behind it.
Not enough data yet$0.025β€”Not published by the providerNot enough data yetNot measuredNot measured
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04cache read $0.01$0.19131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Groq
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.50Not published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Together AI
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.20Not published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Granite 4.2 8B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
110.9
From 57 benchmarks. Plenty of data behind it.
90Β Β±17
Coding IQ 90.2, 95% interval 73–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.015$0.25131KNot enough data yetNot measuredNot measured
Granite 4.2 8B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
110.9
From 57 benchmarks. Plenty of data behind it.
90Β Β±17
Coding IQ 90.2, 95% interval 73–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.015$0.25Not published by the providerNot enough data yetNot measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works