Skip to content

Listings

All listings: Wafer

Every listing for Wafer's models, including each model's other versions and routes. Back to Wafer

Sold by Wafer

13 listings sold by Wafer.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$10.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Kimi-K3.1-Pro-US · mxfp4 · 🇺🇸 us
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$10.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.01$0.501M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
mxfp4
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.20$15.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.18$1.801M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
mxfp4
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.19cache read $0.01$0.651M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
nvfp4
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.02$0.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp4
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.19cache read $0.18$4.401M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.03$0.201M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
DeepSeek-V4-Flash-0731-Fast · fast · nvfp4
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.03$0.231M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.28cache read $0.04$3.961M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.05$2.30262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
DeepSeek-V4-Flash-0423 · 0423
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.03$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Run by Wafer

57 listings where Wafer runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.253$8.801M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4
 OpenRouter
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.80cache read $0.18$9.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us · mxfp4
 OpenRouter
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.253cache read $0.18$8.801M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.036$0.501M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4 · 🇺🇸 US
 NanoGPT
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0693cache read $0.0068$0.525Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepseek/deepseek-v4.1-flash-1017:thinking · thinking · mxfp4 · 🇺🇸 US
 NanoGPT
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0693cache read $0.0068$0.525Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4
 OpenRouter
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.066cache read $0.0065$0.501M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us · mxfp4
 OpenRouter
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.036cache read $0.01$0.501M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 Hugging Face
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.276$9.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
mxfp4 · 🇺🇸 US
 NanoGPT
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.2898cache read $0.1365$10.08Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
mxfp4
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.192cache read $0.182$16.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fast · mxfp4
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.153cache read $0.152$16.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
us · mxfp4
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.276cache read $0.13$9.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0699$1.401M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4 · 🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.188cache read $0.1869$1.47Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
z-ai/glm-5.3:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.188cache read $0.1869$1.47Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.179cache read $0.178$1.401M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us · fp4
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0699cache read $0.0689$1.401M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.051$0.5671M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
mxfp4 · 🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1995cache read $0.0126$0.6825Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
deepseek/deepseek-v4.1-flash:thinking · thinking · mxfp4 · 🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1995cache read $0.0126$0.6825Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.111$4.441M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4 · 🇺🇸 US
 NanoGPT
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.294cache read $0.0462$4.158Not published by the provider
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepseek/deepseek-v4-pro-0813:thinking · thinking · mxfp4 · 🇺🇸 US
 NanoGPT
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.294cache read $0.0462$4.158Not published by the provider
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mxfp4
 OpenRouter
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.285cache read $0.284$4.301M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us · mxfp4
 OpenRouter
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.111cache read $0.097$4.441M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.135$0.541M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
nvfp4 · 🇺🇸 US
 NanoGPT
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1575cache read $0.0158$0.63Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
nvfp4
 OpenRouter
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.135cache read $0.0135$0.541M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
 Hugging Face
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.007$6.801M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp4 · 🇺🇸 US
 NanoGPT
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1995cache read $0.189$8.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
z-ai/glm-5.2:thinking · thinking · fp4 · 🇺🇸 US
 NanoGPT
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1995cache read $0.189$8.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp4
 OpenRouter
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.19cache read $0.18$8.001M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
us · fp4
 OpenRouter
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.007cache read $0.006$6.801M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.042$0.1841M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4 · 🇺🇸 US
 NanoGPT
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0525cache read $0.0315$0.21Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
 OpenRouter
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.065cache read $0.064$0.241M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us · nvfp4
 OpenRouter
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.042cache read $0.041$0.1841M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 Hugging Face
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0443$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
nvfp4 · 🇺🇸 US
 NanoGPT
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.1313$0.2415Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0731:thinking · thinking · nvfp4 · 🇺🇸 US
 NanoGPT
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.1313$0.2415Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fast · nvfp4
 OpenRouter
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.125$0.231M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us · nvfp4
 OpenRouter
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0443cache read $0.035$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · mxfp4
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.19cache read $0.012$0.651MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us · mxfp4
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.051cache read $0.018$0.5671MNot enough data yetNot measuredNot measured
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
🇺🇸 US
 NanoGPT
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.063cache read $0.0525$2.415Not published by the provider
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3.8-27b:thinking · thinking · 🇺🇸 US
 NanoGPT
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.063cache read $0.0525$2.415Not published by the provider
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 Hugging Face
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.171M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
mxfp4 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0294$0.2415Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0423 · 0423 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.147cache read $0.0294$0.294Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-latest · latest · mxfp4 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0693cache read $0.0068$0.525Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash:thinking · thinking · mxfp4 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1365cache read $0.0294$0.2415Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0423:thinking · thinking+0423 · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.147cache read $0.0294$0.294Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
mxfp4
 OpenRouter
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12cache read $0.024$0.171M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Hermes High
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Router
This is a router, not a fixed model. The provider chooses which model answers, and that choice can change.
fp4 · 🇺🇸 US
 NanoGPTNot enough data yetNot enough data yet$0.188cache read $0.1869$1.47Not published by the providerNot enough data yetNot measuredNot measured
Hermes Low
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Router
This is a router, not a fixed model. The provider chooses which model answers, and that choice can change.
fp4 · 🇺🇸 US
 NanoGPTNot enough data yetNot enough data yet$0.188cache read $0.1869$1.47Not published by the providerNot enough data yetNot measuredNot measured
Hermes Medium
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Router
This is a router, not a fixed model. The provider chooses which model answers, and that choice can change.
fp4 · 🇺🇸 US
 NanoGPTNot enough data yetNot enough data yet$0.188cache read $0.1869$1.47Not published by the providerNot enough data yetNot measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works