Skip to content

Listings

All listings: OpenRouter

Every listing for the models on page 11 of 26 of OpenRouter, including each model's other versions and routes. Back to OpenRouter

Sold by OpenRouter

77 listings on this page sold by OpenRouter.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Qwen3 30B A3B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b-instruct-2507
114.9
From 100 benchmarks. Plenty of data behind it.
≈ 86 ±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b-instruct-2507 · fp8
Inference by Nebius AI Studio
114.9
From 100 benchmarks. Plenty of data behind it.
≈ 86 ±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b-instruct-2507 · fp8
Inference by SiliconFlow
114.9
From 100 benchmarks. Plenty of data behind it.
≈ 86 ±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
114.7
From 48 benchmarks. Plenty of data behind it.
≈ 91 ±14
Coding IQ 90.8, 95% interval 76–105. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.75$8.10Not published by the provider
24.3
Poor value (24.3). Costs more per task than its benchmark results predict. A fair amount of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Trinity Large Thinking
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
114.7
From 97 benchmarks. Plenty of data behind it.
92 ±10
Coding IQ 91.8, 95% interval 82–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.06$0.85Not published by the provider
25.1
Poor value (25.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Llama 3.1 Nemotron Ultra 253B v1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
114.6
From 37 benchmarks. A fair amount of data behind it.
Not enough data yet$0.60$1.80Not published by the providerNot enough data yetNot measuredNot measured
Gemini 2.0 Flash Experimental
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
google/gemini-2.0-flash-exp:free · free
114.5
From 159 benchmarks. Plenty of data behind it.
≈ 82 ±12stale
Coding IQ 82.3, 95% interval 70–94. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.00$0.00Not published by the provider
68.2
Good value (68.2). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Llama 3.3 Nemotron Super 49B v1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
114.4
From 32 benchmarks. A fair amount of data behind it.
Not enough data yet$0.13$0.40Not published by the providerNot enough data yetNot measuredNot measured
Qwen3 30B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b-thinking-2507 · thinking+2507
114.4
From 142 benchmarks. Plenty of data behind it.
90 ±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.40Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b:free · free
114.4
From 142 benchmarks. Plenty of data behind it.
90 ±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.00$0.00Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
114.4
From 142 benchmarks. Plenty of data behind it.
90 ±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.5041K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by DeepInfra
114.4
From 142 benchmarks. Plenty of data behind it.
90 ±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.5041K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex · fp8
Inference by DeepInfra
114.4
From 142 benchmarks. Plenty of data behind it.
90 ±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.096$0.4041K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Pixtral Large
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/pixtral-large-2411 · 2411
114.2
From 15 benchmarks. Plenty of data behind it.
Not enough data yet$2.00$6.00Not published by the provider
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Pixtral Large
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/pixtral-large-2502 · 2502
114.2
From 15 benchmarks. Plenty of data behind it.
Not enough data yet$2.00$6.00128K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Pixtral Large
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/pixtral-large-2502 · 2502
Inference by Amazon Web Services
114.2
From 15 benchmarks. Plenty of data behind it.
Not enough data yet$2.00$6.00128K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen/qwen3-14b:free · free
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.00$0.00Not published by the provider
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.2441K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8
Inference by DeepInfra
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.2441K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8/flex · fp8
Inference by DeepInfra
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.096$0.19241K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8/priority · fp8
Inference by DeepInfra
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.18$0.3641K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 14B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
int4
Inference by Nextbit
114.1
From 210 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.2241K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o:extended · extended
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$6.00$18.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-05-13 · 2024-05-13
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00$15.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-08-06 · 2024-08-06
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-11-20 · 2024-11-20
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o:batch · batch
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.625$5.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-05-13 · 2024-05-13
Inference by Microsoft Azure
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00$15.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-08-06 · 2024-08-06
Inference by Microsoft Azure
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-08-06 · 2024-08-06
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-11-20 · 2024-11-20
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.401M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.401M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
flex
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.201M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
priority
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.18cache read $0.018$0.721M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4 32B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
113.3
From 10 benchmarks. A fair amount of data behind it.
Not enough data yet$0.24$0.24Not published by the provider
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/mistral-small-3.2-24b-instruct:free · free
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.00$0.00Not published by the provider
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.075$0.20128K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by DeepInfra
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.075$0.20128K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex · fp8
Inference by DeepInfra
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.06$0.16128K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/priority · fp8
Inference by DeepInfra
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.1125$0.30128K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
Inference by Parasail
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.09cache read $0.05$0.30131K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small 3.2 24B Instruct
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Venice
113.3
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.0938$0.25256K
58.5
Good value (58.5). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.17$0.25262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Darkbloom
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08cache read $0.04$0.13262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
Inference by DeepInfra
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.15262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16/flex · bf16
Inference by DeepInfra
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.12262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16/priority · bf16
Inference by DeepInfra
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.225262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
Inference by Parasail
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.25262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
Inference by Primeintellect
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.143cache read $0.128$0.21262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by SiliconFlow
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.15262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 9B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Together AI
113.2
From 223 benchmarks. Plenty of data behind it.
86 ±8
Coding IQ 85.6, 95% interval 77–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.17$0.25262K
55.4
Good value (55.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
139.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Olmo 3 32B Think
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionOlmo 3.1 32B ThinkWe compared release dates and version names in our catalogue.
≈ 113
From 52 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.15$0.50Not published by the provider
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Devstral Small 2505
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
devstral-small
112.7
From 14 benchmarks. A fair amount of data behind it.
≈ 83 ±10stale
Coding IQ 82.9, 95% interval 73–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.06$0.12Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Devstral Small 2505
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
2505
112.7
From 14 benchmarks. A fair amount of data behind it.
≈ 83 ±10stale
Coding IQ 82.9, 95% interval 73–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.05$0.22Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Devstral Small 2505
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/devstral-small-2505:free · free+2505
112.7
From 14 benchmarks. A fair amount of data behind it.
≈ 83 ±10stale
Coding IQ 82.9, 95% interval 73–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
——Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Grok 2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-2-1212 · 1212
112.6
From 78 benchmarks. Plenty of data behind it.
≈ 83 ±10
Coding IQ 83.1, 95% interval 73–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$10.00Not published by the provider
25.9
Poor value (25.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
129.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Magistral Medium
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
magistral-medium-2506 · 2506
112.6
From 69 benchmarks. Plenty of data behind it.
92 ±10
Coding IQ 91.6, 95% interval 82–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$5.00Not published by the provider
22.3
Poor value (22.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Magistral Medium
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/magistral-medium-2506:thinking · thinking+2506
112.6
From 69 benchmarks. Plenty of data behind it.
92 ±10
Coding IQ 91.6, 95% interval 82–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$5.00Not published by the provider
22.3
Poor value (22.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Nova 2 Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
amazon/nova-2-lite-v1
112.6
From 78 benchmarks. Plenty of data behind it.
94 ±41
Coding IQ 94.4, 95% interval 53–136. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$2.501M
38.2
Poor value (38.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nova 2 Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
amazon/nova-2-lite-v1 · eu-west-1
Inference by Amazon Web Services
112.6
From 78 benchmarks. Plenty of data behind it.
94 ±41
Coding IQ 94.4, 95% interval 53–136. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$2.501M
38.2
Poor value (38.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nova 2 Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
amazon/nova-2-lite-v1
Inference by Amazon Web Services
112.6
From 78 benchmarks. Plenty of data behind it.
94 ±41
Coding IQ 94.4, 95% interval 53–136. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$2.501M
38.2
Poor value (38.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Jamba Large 1.7
🇮🇱
Maker headquartered in IL, according to the company's own website. The citation is on the model page.
112.5
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$2.00$8.00Not published by the provider
31.8
Poor value (31.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3 8B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
112.4
From 182 benchmarks. Plenty of data behind it.
80 ±12
Coding IQ 80.3, 95% interval 68–92. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.035$0.138Not published by the provider
58.0
Good value (58.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
132.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 8B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-8b:free · free
112.4
From 182 benchmarks. Plenty of data behind it.
80 ±12
Coding IQ 80.3, 95% interval 68–92. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.00$0.00Not published by the provider
58.0
Good value (58.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
132.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
gemini-pro-1.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 2.5 ProWe compared the version names in our catalogue.
≈ 112
From 19 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.25$5.00Not published by the providerNot enough data yetNot measuredNot measured
Llama 3.1 405B Instruct
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
111.8
From 123 benchmarks. Plenty of data behind it.
84 ±9
Coding IQ 84.3, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80$0.80Not published by the provider
41.9
Poor value (41.9). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Llama 4 Maverick
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/llama-4-maverick:free · free
111.8
From 350 benchmarks. Plenty of data behind it.
78 ±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.00$0.00Not published by the provider
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 ±9
Terse (38 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Maverick
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
111.8
From 350 benchmarks. Plenty of data behind it.
78 ±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.35cache read $0.17$1.00524K
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 ±9
Terse (38 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Maverick
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us-east5
Inference by Google
111.8
From 350 benchmarks. Plenty of data behind it.
78 ±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.35$1.15524K
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 ±9
Terse (38 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Maverick
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Parasail
111.8
From 350 benchmarks. Plenty of data behind it.
78 ±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.35cache read $0.17$1.00524K
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 ±9
Terse (38 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
openai/gpt-4-0314 · 0314
111.6
From 224 benchmarks. Plenty of data behind it.
≈ 78 ±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
111.6
From 224 benchmarks. Plenty of data behind it.
≈ 78 ±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.008K
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
111.6
From 224 benchmarks. Plenty of data behind it.
≈ 78 ±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.008K
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works