Skip to content

Listings

All listings: Fireworks AI

Every listing for the models on page 1 of 13 of Fireworks AI, including each model's other versions and routes. Back to Fireworks AI

Sold by Fireworks AI

35 listings on this page sold by Fireworks AI.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/kimi-k3p1-pro
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$10.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/kimi-k3p1-pro-us · 🇺🇸 us
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.25$12.501M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/deepseek-v4p1-flash-1017
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.201M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/deepseek-v4p1-flash-1017-flex · flex
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.003$0.601M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/deepseek-v4p1-flash-1017-us · 🇺🇸 us
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.009$1.801M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
accounts/fireworks/routers/kimi-k3-fast · fast
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$4.50cache read $0.45$22.501M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
accounts/fireworks/models/qwen3p8-2p4t-a95b
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.25$6.00262K
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/glm-5p3
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.401M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/routers/glm-5p3-fast · fast
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.39$6.601M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/glm-5p3-us · 🇺🇸 us
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.39$6.601M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
accounts/fireworks/models/deepseek-v4p1-flash
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.201M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fireworks_ai/accounts/fireworks/routers/deepseek-v4p1-flash-us · 🇺🇸 us
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.009$1.801M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro 0813
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
136.8
From 147 benchmarks. Plenty of data behind it.
117 ±7
Coding IQ 117.1, 95% interval 110–124. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.32cache read $0.044$3.961M
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
156
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash Vision Exp
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
136.6
From 32 benchmarks. A fair amount of data behind it.
≈ 110 ±19
Coding IQ 109.6, 95% interval 90–129. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.007$0.661M
63.0
Good value (63.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Muse Spark Open
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
136.3
From 58 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.5, 95% interval 105–122. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.15$4.251M
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
155.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
accounts/fireworks/models/minimax-m3p1-flash
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
DeepSeek Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/deepseek-flash-latest · latest
≈ 134
From 5 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
accounts/fireworks/routers/glm-5p2-fast · fast
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.21$6.601M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
glm-5p2
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.14$4.401M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fireworks_ai/accounts/fireworks/routers/glm-5p2-fast-us · fast · 🇺🇸 us
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.21$6.601M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/glm-5p3-flash
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.501M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/glm-5p3-flash-us · 🇺🇸 us
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.225cache read $0.045$0.751M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
kimi-k2p6
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.16$4.00262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fireworks_ai/accounts/fireworks/routers/kimi-k2p6-fast · fast
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.30$8.00262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.007$0.661M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 Embedding 8B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
131.7
From 196 benchmarks. Plenty of data behind it.
Not enough data yet$0.10—41KNot enough data yetNot measuredNot measured
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
glm-5p1
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fireworks_ai/accounts/fireworks/routers/glm-5p1-fast · fast
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.80cache read $0.52$8.80203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.74cache read $0.145$3.481M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
qwen3p7-plus
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.08$1.60262K
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.7 PlusWe compared release dates and version names in our catalogue.
qwen3p6-plus
129.4
From 256 benchmarks. Plenty of data behind it.
106 ±5
Coding IQ 105.7, 95% interval 101–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.10$3.00Not published by the provider
38.6
Poor value (38.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
44 ±12
Terse (44 ±12). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.028$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
kimi-k2p5
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.10$3.00262K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Muse Glimmer 30B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
128.3
From 58 benchmarks. Plenty of data behind it.
Not enough data yet$0.35cache read $0.04$1.50131K
51.7
Fair value (51.7). Costs per task about what its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured

Run by Fireworks AI

56 listings on this page where Fireworks AI runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$10.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/kimi-k3p1-pro
 Llmgateway
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$10.00Not published by the provider
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3.1 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
142.7
From 161 benchmarks. Plenty of data behind it.
131 ±10
Coding IQ 131.3, 95% interval 121–141. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$10.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
161.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.201M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/deepseek-v4p1-flash-1017
 Llmgateway
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.20Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/deepseek-v4p1-flash-1017 · latest
 Llmgateway
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.20Not published by the provider
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.006$1.201M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 1017
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us
 OpenRouter
139.7
From 97 benchmarks. Plenty of data behind it.
127 ±8
Coding IQ 126.8, 95% interval 119–135. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.009$1.801M
71.4
Good value (71.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
159.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 Hugging Face
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00$15.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 Llmgateway
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
accounts/fireworks/routers/kimi-k3-fast · fast
 Llmgateway
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$4.50cache read $0.45$22.50Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
🇺🇸 US
 NanoGPT
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.15cache read $0.315$15.75Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fast · 🇺🇸 US
 NanoGPT
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$4.725cache read $0.4725$23.625Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
fast
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$4.50cache read $0.45$22.501M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
us
 OpenRouter
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$4.50cache read $0.45$22.501M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
 Requesty
139.2
From 417 benchmarks. Plenty of data behind it.
124 ±7
Coding IQ 123.8, 95% interval 117–131. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.001M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
158.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
Qwen/Qwen3.8-2.4T-A95B
 Hugging Face
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$6.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
accounts/fireworks/models/qwen3p8-2p4t-a95b
 Llmgateway
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.25$6.00Not published by the provider
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
🇺🇸 US
 NanoGPT
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.2625$6.30Not published by the provider
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
qwen/qwen3.8-max:thinking · thinking · 🇺🇸 US
 NanoGPT
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.2625$6.30Not published by the provider
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
qwen/qwen3.8-2.4t-a95b
 OpenRouter
138.7
From 312 benchmarks. Plenty of data behind it.
117 ±5
Coding IQ 117.2, 95% interval 112–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.25$6.001M
49.2
Fair value (49.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
157.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70$2.201M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/glm-5p3
 Llmgateway
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.47cache read $0.273$4.62Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
z-ai/glm-5.3:thinking · thinking · 🇺🇸 US
 NanoGPT
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.47cache read $0.273$4.62Not published by the provider
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.401M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fast
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.10cache read $0.39$6.601M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
spot
 OpenRouter
138.2
From 318 benchmarks. Plenty of data behind it.
121 ±9
Coding IQ 121.0, 95% interval 112–130. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70cache read $0.13$2.201M
57.7
Good value (57.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
65 ±10
Chatty (65 ±10). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
157.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.601M
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
accounts/fireworks/models/deepseek-v4p1-flash
 Llmgateway
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.007$0.66Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.315cache read $0.0063$1.26Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
deepseek/deepseek-v4.1-flash:thinking · thinking · 🇺🇸 US
 NanoGPT
137.7
From 179 benchmarks. Plenty of data behind it.
125 ±16
Coding IQ 124.7, 95% interval 109–140. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.315cache read $0.0063$1.26Not published by the provider
68.1
Good value (68.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
60 ±9
Chatty (60 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
157
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Muse Spark Open
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Eden AI
136.3
From 58 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.5, 95% interval 105–122. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.15$4.251M
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
155.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Muse Spark Open
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Llmgateway
136.3
From 58 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.5, 95% interval 105–122. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.15$4.25Not published by the provider
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
155.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Muse Spark Open
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
🇺🇸 US
 NanoGPT
136.3
From 58 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.5, 95% interval 105–122. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.3125cache read $0.1575$4.4625Not published by the provider
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
155.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Muse Spark Open
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
136.3
From 58 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.5, 95% interval 105–122. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.15$4.251M
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
155.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Hugging Face
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
accounts/fireworks/models/minimax-m3p1-flash
 Llmgateway
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
🇺🇸 US
 NanoGPT
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1575cache read $0.0158$0.63Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 OpenRouter
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.601M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Muse Spark Open 816B A42B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
134.2
From 13 benchmarks. Plenty of data behind it.
≈ 113 ±10
Coding IQ 113.1, 95% interval 103–124. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$4.251M
56.0
Good value (56.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.501M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/glm-5p3-flash
 Llmgateway
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
🇺🇸 US
 NanoGPT
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1575cache read $0.0315$0.525Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.501M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
us
 OpenRouter
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.225cache read $0.045$0.751M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.30cache read $0.006$1.201MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · spot
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.15cache read $0.003$0.601MNot enough data yetNot measuredNot measured
DeepSeek V4.1 Flash 0910
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Later snapshot
Later snapshotDeepSeek V4.1 Flash 1017We compared the dates in the model names.
deepseek/deepseek-v4.1-flash · us
 OpenRouter
≈ 131
From 67 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.45cache read $0.009$1.801MNot enough data yetNot measuredNot measured
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/deepseek-v4-pro-0813
 Llmgateway
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.32cache read $0.044$3.96Not published by the provider
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 Hugging Face
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.141M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
accounts/fireworks/models/deepseek-v4-flash-0731
 Llmgateway
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22cache read $0.007$0.66Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0735cache read $0.0147$0.147Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepseek/deepseek-v4-flash:thinking · thinking · 🇺🇸 US
 NanoGPT
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0735cache read $0.0147$0.147Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 OpenRouter
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07cache read $0.014$0.141M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works