Skip to content

Listings

All listings: Coreweave

Every listing for the models on page 1 of 2 of Coreweave, including each model's other versions and routes. Back to Coreweave

Run by Coreweave

74 listings on this page where Coreweave runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.201M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 · 🇺🇸 US
 NanoGPT
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.315cache read $0.0063$1.26Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepseek/deepseek-v4.1-flash-1017:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.315cache read $0.0063$1.26Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
 OpenRouter
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.201M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75$3.001M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4 · 🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.7875cache read $0.1995$3.15Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
z-ai/glm-5.3:thinking · thinking · nvfp4 · 🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.7875cache read $0.1995$3.15Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.19$3.001M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.651M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8 · 🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0021$0.6825Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
deepseek/deepseek-v4.1-flash:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0021$0.6825Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.31$3.961M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 · 🇺🇸 US
 NanoGPT
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.3755cache read $0.0462$4.158Not published by the provider
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepseek/deepseek-v4-pro-0813:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.3755cache read $0.0462$4.158Not published by the provider
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
 OpenRouter
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.31cache read $0.044$3.961M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
 Hugging Face
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.62$2.421M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp4 · 🇺🇸 US
 NanoGPT
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.651cache read $0.147$2.541Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
z-ai/glm-5.2:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.651cache read $0.147$2.541Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp4
 OpenRouter
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.62cache read $0.14$2.421M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.381M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4 · 🇺🇸 US
 NanoGPT
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.126cache read $0.021$0.399Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
 OpenRouter
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12cache read $0.02$0.381M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 Hugging Face
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.65$3.41262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4 · 🇺🇸 US
 NanoGPT
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.6825cache read $0.1575$3.5805Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
moonshotai/kimi-k2.6:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.6825cache read $0.1575$3.5805Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4
 OpenRouter
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.65cache read $0.15$3.41262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 Hugging Face
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.27262K
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8 · 🇺🇸 US
 NanoGPT
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0525$0.2835Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0731:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0525$0.2835Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
 OpenRouter
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.05$0.27262K
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.13cache read $0.002$0.651MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.001MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
 OpenRouter
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.04$1.001MNot enough data yetNot measuredNot measured
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$3.00262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 · 🇺🇸 US
 NanoGPT
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.42cache read $0.1575$3.15Not published by the provider
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3.8-27b:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.42cache read $0.1575$3.15Not published by the provider
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
 OpenRouter
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.15$3.00262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-latest · latest · fp8 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.315cache read $0.0063$1.26Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.34262K
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4 · 🇺🇸 US
 NanoGPT
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105$0.357Not published by the provider
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-31b-it:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105$0.357Not published by the provider
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
 OpenRouter
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.34262K
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
int4 · 🇺🇸 US
 NanoGPT
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.63cache read $0.126$3.15Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
int4
 OpenRouter
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$3.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.96262K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp4 · 🇺🇸 US
 NanoGPT
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.2415cache read $0.0525$1.008Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
minimax/minimax-m3:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.2415cache read $0.0525$1.008Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp4
 OpenRouter
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23cache read $0.05$0.96262K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3.5 Super VL
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4 · 🇺🇸 US
 NanoGPT
125.9
From 18 benchmarks. A fair amount of data behind it.
Not enough data yet$0.1575cache read $0.021$0.4935Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
Not measured
Nemotron 3.5 Super VL
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
 OpenRouter
125.9
From 18 benchmarks. A fair amount of data behind it.
Not enough data yet$0.15cache read $0.02$0.471M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
Not measured
NVIDIA Nemotron 3.5 Super VL 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 · bf16
 Hugging Face
125.0
From 100 benchmarks. Plenty of data behind it.
104 ±6
Coding IQ 104.2, 95% interval 98–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.471M
23.2
Poor value (23.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26B-A4B-it
 Hugging Face
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26b-a4b-it · bf16 · 🇺🇸 US
 NanoGPT
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105cache read $0.0525$0.315Not published by the provider
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26b-a4b-it:thinking · thinking · bf16 · 🇺🇸 US
 NanoGPT
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105cache read $0.0525$0.315Not published by the provider
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26b-a4b-it · bf16
 OpenRouter
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.05$0.30262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · bf16
 Hugging Face
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$2.15262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/nemotron-3-ultra-550b-a55b · bf16
 OpenRouter
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.10$2.15262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 35B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
119.8
From 160 benchmarks. Plenty of data behind it.
95 ±14
Coding IQ 94.8, 95% interval 81–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.89262K
38.5
Poor value (38.5). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 35B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 · 🇺🇸 US
 NanoGPT
119.8
From 160 benchmarks. Plenty of data behind it.
95 ±14
Coding IQ 94.8, 95% interval 81–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105cache read $0.0368$0.9345Not published by the provider
38.5
Poor value (38.5). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 35B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3.6-35b-a3b:thinking · thinking · fp8 · 🇺🇸 US
 NanoGPT
119.8
From 160 benchmarks. Plenty of data behind it.
95 ±14
Coding IQ 94.8, 95% interval 81–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105cache read $0.0368$0.9345Not published by the provider
38.5
Poor value (38.5). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
119.6
From 122 benchmarks. Plenty of data behind it.
94 ±8
Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$1.50161K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
140.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 · 🇺🇸 US
 NanoGPT
119.6
From 122 benchmarks. Plenty of data behind it.
94 ±8
Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.525cache read $0.21$1.575Not published by the provider
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
140.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepseek/deepseek-chat-v3.1 · fp8
 OpenRouter
119.6
From 122 benchmarks. Plenty of data behind it.
94 ±8
Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.20$1.50161K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
140.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.17131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4 · 🇺🇸 US
 NanoGPT
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0315$0.1785Not published by the provider
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
 OpenRouter
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.17131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3.5 Lightning
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16 · 🇺🇸 US
 NanoGPT
116.2
From 12 benchmarks. A fair amount of data behind it.
Not enough data yet$0.0735cache read $0.042$0.21Not published by the provider
49.3
Fair value (49.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3.5 Lightning
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/nemotron-3.5-lightning:thinking · thinking · bf16 · 🇺🇸 US
 NanoGPT
116.2
From 12 benchmarks. A fair amount of data behind it.
Not enough data yet$0.0735cache read $0.042$0.21Not published by the provider
49.3
Fair value (49.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3.5 Lightning
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
 OpenRouter
116.2
From 12 benchmarks. A fair amount of data behind it.
Not enough data yet$0.07cache read $0.04$0.20262K
49.3
Fair value (49.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3.5 Lightning 30B A3B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 · bf16
 Hugging Face
114.4
From 121 benchmarks. Plenty of data behind it.
92 ±22
Coding IQ 91.7, 95% interval 70–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.20262K
30.6
Poor value (30.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GPT OSS 20b
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
111.3
From 251 benchmarks. Plenty of data behind it.
88 ±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.13131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4 · 🇺🇸 US
 NanoGPT
111.3
From 251 benchmarks. Plenty of data behind it.
88 ±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0315$0.1365Not published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
 OpenRouter
111.3
From 251 benchmarks. Plenty of data behind it.
88 ±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.13131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works