Skip to content

Listings

All listings: OpenRouter

Every listing for the models on page 4 of 26 of OpenRouter, including each model's other versions and routes. Back to OpenRouter

Sold by OpenRouter

229 listings on this page sold by OpenRouter.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Step 5 Preview
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
132.7
From 119 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 115.2, 95% interval 108–123. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$2.701M
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Step 5 Preview
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Featherless AI
132.7
From 119 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 115.2, 95% interval 108–123. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$2.70262K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Step 5 Preview
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by StepFun
132.7
From 119 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 115.2, 95% interval 108–123. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$2.701M
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.65cache read $0.15$3.41262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4
Inference by Baidu
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.3895cache read $0.0656$1.64262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
int4
Inference by Chutes
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.39cache read $0.039$1.80262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4
Inference by Coreweave
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.65cache read $0.15$3.41262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bf16
Inference by Crusoe
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70cache read $0.35$3.50262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4
Inference by DeepInfra
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.15$3.50262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4/flex · fp4
Inference by DeepInfra
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.80262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp4/priority · fp4
Inference by DeepInfra
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.125cache read $0.225$5.25262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Digitalocean
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.57cache read $0.114$2.40262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
int4
Inference by Inceptron
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.5648cache read $0.19$2.788262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Moonshot AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.16$4.00262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Novita AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80cache read $0.16$3.40262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
int4
Inference by Parasail
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.16$3.50262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp8
Inference by SiliconFlow
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.77cache read $0.14$3.40262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fp8
Inference by Streamlake
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.5985cache read $0.1008$2.52256K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
int4
Inference by Venice
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.16$3.50256K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0443cache read $0.035$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0731:batch · batch
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.048cache read $0.012$0.1441M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.352cache read $0.0352$1.0561M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us-east-1
Inference by Alibaba Cloud
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.374cache read $0.0374$1.1221M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Baidu
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.044cache read $0.0014$0.1321M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp32
Inference by Baseten
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.028$0.261M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Baseten
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.028$0.261M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Chutes
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.044$1.321M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Cohere
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.11cache read $0.05$0.221M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Coreweave
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.05$0.27262K
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash-0731:batch · batch+fp8 · fp8
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.048cache read $0.012$0.1441M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.015$0.181M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8/flex · fp8
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.048cache read $0.012$0.1441M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8/priority · fp8
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09cache read $0.0225$0.271M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Digitalocean
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.119cache read $0.0238$0.2381M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp4
Inference by Inceptron
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.027$0.4951M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Mancer 2
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.05$0.501M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Nebius AI Studio
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.01$0.281M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Novita AI
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.418cache read $0.0266$1.2541M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Parasail
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.05$0.281M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp4
Inference by Primeintellect
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.014$1.321M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp4
Inference by Relace
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07cache read $0.014$0.141M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp4
Inference by Sail Research
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.042$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us · fp4
Inference by Sail Research
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.042$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by SiliconFlow
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.028$0.661M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Streamlake
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.088cache read $0.0028$0.2641M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Venice
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.028$0.261M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fast · nvfp4
Inference by Wafer
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.135$0.231M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us · nvfp4
Inference by Wafer
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0443cache read $0.035$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.001M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview:batch · batch
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25$1.501M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.001M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview:batch · batch+global
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25$1.501M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview · flex
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.501M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview · global
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.001M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview · global/flex
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.501M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview · global/priority
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.09$5.401M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
google/gemini-3-flash-preview · priority
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.09$5.401M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
131.9
From 52 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 109.8, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
52.6
Good value (52.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
59 ±11
Chatty (59 ±11). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.2 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
Inference by Microsoft Azure
131.9
From 52 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 109.8, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00272K
52.6
Good value (52.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
59 ±11
Chatty (59 ±11). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
openai/gpt-5:batch · batch
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.625cache read $0.0625$5.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
default
Inference by OpenAI
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Hy4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
New
Released 16 Nov 2026
131.7
From 26 benchmarks. Plenty of data behind it.
≈ 115 ±24
Coding IQ 115.3, 95% interval 91–140. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.035cache read $0.0015$0.14051M
65.5
Good value (65.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
Not measured
Hy4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
New
Released 16 Nov 2026
fp8
Inference by Tencent
131.7
From 26 benchmarks. Plenty of data behind it.
≈ 115 ±24
Coding IQ 115.3, 95% interval 91–140. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.035cache read $0.0015$0.14051M
65.5
Good value (65.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
Not measured
Inkling 2 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
New
Released 20 Nov 2026
131.2
From 33 benchmarks. A fair amount of data behind it.
106 ±18
Coding IQ 106.0, 95% interval 89–124. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075cache read $0.015$0.301MNot enough data yetNot measuredNot measured
Inkling 2 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
New
Released 20 Nov 2026
nvfp4
Inference by Ionet
131.2
From 33 benchmarks. A fair amount of data behind it.
106 ±18
Coding IQ 106.0, 95% interval 89–124. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08cache read $0.016$0.35262KNot enough data yetNot measuredNot measured
Inkling 2 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
New
Released 20 Nov 2026
fp4
Inference by Primeintellect
131.2
From 33 benchmarks. A fair amount of data behind it.
106 ±18
Coding IQ 106.0, 95% interval 89–124. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075cache read $0.015$0.301MNot enough data yetNot measuredNot measured
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
openai/gpt-5.1:batch · batch
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.625cache read $0.0625$5.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.13$10.00272K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
fast
Inference by OpenAI
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.25$20.00272K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
flex
Inference by OpenAI
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.625cache read $0.0625$5.00272K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash:batch · batch
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.05cache read $0.004$0.151MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.0498cache read $0.001$0.19921MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Alibaba Cloud
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.18cache read $0.0036$0.721MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Baidu
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.0498cache read $0.001$0.19921MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Baseten
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.007$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us
Inference by Baseten
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.007$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Cloudflare Workers AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.10cache read $0.03$0.901MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Cohere
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.195cache read $0.003$0.661MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Coreweave
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.13cache read $0.002$0.651MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Crusoe
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.29cache read $0.007$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash:batch · batch+fp8 · fp8
Inference by DeepInfra
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.112cache read $0.0034$0.3361MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by DeepInfra
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.14cache read $0.0042$0.421MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8/priority · fp8
Inference by DeepInfra
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.21cache read $0.0063$0.631MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Digitalocean
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.195cache read $0.0039$0.781MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Fireworks AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · spot
Inference by Fireworks AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.15cache read $0.003$0.601MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us
Inference by Fireworks AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.45cache read $0.009$1.801MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · global
Inference by Google
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.03$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Inferencenet
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.103cache read $0.008$0.601MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us · fp8
Inference by Inferencenet
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.103cache read $0.008$0.601MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Ionstream
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.20cache read $0.02$0.701MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Makora
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.26cache read $0.0058$1.171MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Mancer 2
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.2125cache read $0.07$0.751MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Modal
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.03$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Nebius AI Studio
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.01$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Novita AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.15cache read $0.003$0.601MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp4
Inference by Openinference
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.05cache read $0.002$0.801MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fast · fp8
Inference by Parasail
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.45cache read $0.009$1.801MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Parasail
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Reka AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.12cache read $0.008$0.641MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp4
Inference by Relace
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.12cache read $0.003$0.501MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by River
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.12cache read $0.0024$0.481MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash:batch · batch+fp4 · fp4
Inference by Sail Research
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.05cache read $0.004$0.151MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by SiliconFlow
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Streamlake
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.147cache read $0.0029$0.5881MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash:batch · batch
Inference by Together AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.111cache read $0.003$0.3351MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
Inference by Together AI
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · fp8
Inference by Venice
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.0075$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · ultrafast · fp8
Inference by Venice
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50cache read $0.03$6.001MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · mxfp4
Inference by Wafer
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.19cache read $0.012$0.651MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us · mxfp4
Inference by Wafer
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.051cache read $0.018$0.5671MNot enough data yetNot measuredNot measured
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.19cache read $0.60$3.74205K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Alibaba Cloud
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.33cache read $0.247$4.18170K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Baidu
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.8988cache read $0.1669$2.8248203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Chutes
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.09$2.90203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Novita AI
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.38cache read $0.26$4.40205K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by SiliconFlow
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.19cache read $0.60$3.74205K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Streamlake
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.966cache read $0.1794$3.036200K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Venice
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.4014cache read $0.2603$4.4044200K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Z.ai
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Max Preview
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionCoding Qwen4 Max PreviewWe compared the version names in our catalogue.
130.8
From 99 benchmarks. Plenty of data behind it.
≈ 109 ±8
Coding IQ 109.3, 95% interval 102–117. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.04$6.24cache write $1.30Not published by the provider
41.5
Poor value (41.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
149.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.20$1.501M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Alibaba Cloud
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.416cache read $0.118$2.8321M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us
Inference by Microsoft Azure
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.91cache read $0.16$3.831M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Baidu
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.6608cache read $0.0547$1.32161M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by DeepInfra
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.30cache read $0.10$2.601M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex · fp8
Inference by DeepInfra
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.04cache read $0.08$2.081M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/priority · fp8
Inference by DeepInfra
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.95cache read $0.15$3.901M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Digitalocean
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.044cache read $0.2088$2.0881M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Novita AI
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.28cache read $0.108$2.561M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Relace
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.20$1.501M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by SiliconFlow
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.08$1.701M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Streamlake
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.6622cache read $0.0552$1.32451M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Venice
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.65cache read $0.33$3.3011M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.22$3.00262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Alibaba Cloud
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.39$2.34258K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by DeepInfra
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.22$3.00262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex · fp8
Inference by DeepInfra
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36cache read $0.176$2.40262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/priority · fp8
Inference by DeepInfra
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.675cache read $0.33$4.50262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.60262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Parasail
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.30$3.60262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Streamlake
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$3.60256K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Venice
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75$4.50128K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.05$1.001MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Baseten
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.04$1.201MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvfp4
Inference by Coreweave
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.04$1.001MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Digitalocean
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.04$1.201MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Nebius AI Studio
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.05$1.001MNot enough data yetNot measuredNot measured
Beam 1.0 501B A23B
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Together AI
130.0
From 84 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 109.0, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.04$1.201MNot enough data yetNot measuredNot measured
O3 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
130.0
From 28 benchmarks. Plenty of data behind it.
Not enough data yet$20.00$80.00200K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
147.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O3 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
130.0
From 28 benchmarks. Plenty of data behind it.
Not enough data yet$20.00$80.00200K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
147.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00>200k $6.00cache read $0.30$15.00>200k $22.50cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
anthropic/claude-sonnet-4.5:batch · batch
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50cache read $0.15$7.50cache write $1.8751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Anthropic
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
global
Inference by Microsoft Azure
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75200K
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Claude Platform On AWS
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
global
Inference by Google
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.20203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Amazon Web Services
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$3.20203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Baidu
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70cache read $0.14$2.24203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Novita AI
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90cache read $0.18$2.88203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by SiliconFlow
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.20$2.55205K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Streamlake
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$1.92198K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Venice
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.20198K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
turbo
Inference by Venice
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.20cache read $0.24$4.00200K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fp8
Inference by Z.ai
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.20203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20 Multi-Agent
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
≈ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.25cache read $0.20$2.502MNot enough data yetNot measuredNot measured
Grok 4.20 Multi-Agent
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
≈ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.25cache read $0.20$2.502MNot enough data yetNot measuredNot measured
Grok 4.20 Multi-Agent
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
priority
Inference by xAI
≈ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$2.50cache read $0.40$5.002MNot enough data yetNot measuredNot measured
Grok 4.20 Multi-Agent
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
zdr
Inference by xAI
≈ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.25cache read $0.20$2.502MNot enough data yetNot measuredNot measured
Grok 4.20 Multi-Agent
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
zdr/priority
Inference by xAI
≈ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$2.50cache read $0.40$5.002MNot enough data yetNot measuredNot measured
Mistral Large 4
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/mistral-large-4-0
129.6
From 173 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 114.7, 95% interval 108–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70cache read $0.07$2.101M
30.8
Poor value (30.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Large 4
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/mistral-large-4-0 · eu
Inference by Mistral AI
129.6
From 173 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 114.7, 95% interval 108–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.77cache read $0.077$2.31524K
30.8
Poor value (30.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Large 4
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistralai/mistral-large-4-0 · zdr
Inference by Mistral AI
129.6
From 173 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 114.7, 95% interval 108–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70cache read $0.07$2.101M
30.8
Poor value (30.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.32cache read $0.064$1.28cache write $0.401M
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen/qwen3.7-plus:batch · batch
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.92262K
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.32cache read $0.064$1.28cache write $0.40984K
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen/qwen3.7-plus:batch · batch
Inference by Alibaba Cloud
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.92246K
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
us-east-1
Inference by Alibaba Cloud
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.32cache read $0.064$1.28cache write $0.40984K
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.7 PlusWe compared release dates and version names in our catalogue.
129.4
From 256 benchmarks. Plenty of data behind it.
106 ±5
Coding IQ 105.7, 95% interval 101–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.325$1.95cache write $0.40631M
38.6
Poor value (38.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
44 ±12
Terse (44 ±12). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.7 PlusWe compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
129.4
From 256 benchmarks. Plenty of data behind it.
106 ±5
Coding IQ 105.7, 95% interval 101–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.325$1.95cache write $0.4063984K
38.6
Poor value (38.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
44 ±12
Terse (44 ±12). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.035cache read $0.0175$1.50262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3.8-27b:batch · batch
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.16cache read $0.04$2.00262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Akash
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.225cache read $0.05$1.98262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Alibaba Cloud
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.425cache read $0.085$2.55cache write $0.53131M
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp16
Inference by Cerebras
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.99$1.4966K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Cloudflare Workers AI
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.05$3.20262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Coreweave
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.15$3.00262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Darkbloom
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.035cache read $0.0175$1.50262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3.8-27b:batch · batch+bf16 · bf16
Inference by DeepInfra
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.16cache read $0.04$2.00262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by DeepInfra
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.0375$1.875262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Dekallm
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04cache read $0.02$2.50262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Ionstream
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04cache read $0.02$1.95262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Modal
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04cache read $0.02$2.30262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Modelrun
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.09$2.50262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Near AI
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04cache read $0.018$1.35262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp4
Inference by Nebius AI Studio
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.10$3.001M
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.42cache read $0.085$3.001M
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Parasail
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.24cache read $0.05$2.20262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Primeintellect
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.448cache read $0.05$3.189262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Reka AI
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.05$2.50262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by SiliconFlow
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.425cache read $0.085$2.55262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Streamlake
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.175cache read $0.035$1.051M
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Tenstorrent
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.05$1.60262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3.8 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Inference by Venice
129.4
From 251 benchmarks. Plenty of data behind it.
111 ±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45$3.20262K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.502M
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.502M
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
priority
Inference by xAI
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.40$5.002M
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
zdr
Inference by xAI
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.502M
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
zdr/priority
Inference by xAI
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.40$5.002M
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09cache read $0.018$0.181M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us
Inference by Microsoft Azure
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.21cache read $0.031$0.561M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Baidu
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0146cache read $0.0029$0.02911M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by DeepInfra
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09cache read $0.018$0.181M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8/flex · fp8
Inference by DeepInfra
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.072cache read $0.0144$0.1441M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8/priority · fp8
Inference by DeepInfra
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.135cache read $0.027$0.271M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Fireworks AI
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07cache read $0.014$0.141M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Mancer 2
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.18cache read $0.07$0.501M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Parasail
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.07$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp4
Inference by Relace
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0138$0.451M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by SiliconFlow
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.028$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
fp8
Inference by Streamlake
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.028cache read $0.0056$0.0561M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Venice
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.138cache read $0.028$0.2751M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
mxfp4
Inference by Wafer
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12cache read $0.024$0.171M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works