Skip to content

Listings

All listings: Fireworks AI

Every listing for the models on page 2 of 13 of Fireworks AI, including each model's other versions and routes. Back to Fireworks AI

Sold by Fireworks AI

30 listings on this page sold by Fireworks AI.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
GLM 4.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
glm-4p7
127.0
From 234 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.30$2.20203K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/inkling
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.17$4.051M
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
kimi-k2p7-code
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.19$4.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/routers/kimi-k2p7-code-fast · fast
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.90cache read $0.38$8.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20512K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
deepseek-v3p2
125.0
From 247 benchmarks. Plenty of data behind it.
101 ±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.56cache read $0.28$1.68164K
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3 235B A22B Thinking 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
124.3
From 161 benchmarks. Plenty of data behind it.
100 ±8stale
Coding IQ 99.6, 95% interval 91–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.22$0.88262K
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/nemotron-3-ultra-nvfp4 · nvfp4
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.40262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 Embedding 4B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
124.1
From 196 benchmarks. Plenty of data behind it.
Not enough data yet——41KNot enough data yetNot measuredNot measured
Kimi K2 Thinking
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
123.8
From 184 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.2, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.50262K
41.6
Poor value (41.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 ±18
Typical (50 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fireworks_ai/accounts/fireworks/models/glm-4p6
123.1
From 174 benchmarks. Plenty of data behind it.
96 ±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.19203K
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
minimax-m2p1
122.3
From 97 benchmarks. Plenty of data behind it.
97 ±6
Coding IQ 96.5, 95% interval 91–102. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.03$1.20197K
45.1
Poor value (45.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±13
Chatty (59 ±13). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek R1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
deepseek-r1-0528 · 0528
121.9
From 412 benchmarks. Plenty of data behind it.
93 ±14
Coding IQ 92.9, 95% interval 79–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00$8.00164K
36.1
Poor value (36.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
60 ±11
Chatty (60 ±11). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
140.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek R1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
121.9
From 412 benchmarks. Plenty of data behind it.
93 ±14
Coding IQ 92.9, 95% interval 79–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00$8.00164K
36.1
Poor value (36.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
60 ±11
Chatty (60 ±11). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
140.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
fireworks_ai/accounts/fireworks/models/glm-4p5
121.9
From 110 benchmarks. Plenty of data behind it.
95 ±7
Coding IQ 95.3, 95% interval 88–103. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.19131K
41.4
Poor value (41.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek V3.1 Terminus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fireworks_ai/accounts/fireworks/models/deepseek-v3p1-terminus
121.4
From 57 benchmarks. Plenty of data behind it.
≈ 99 ±13
Coding IQ 99.4, 95% interval 86–112. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.56$1.68128K
57.6
Good value (57.6). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M1 80K
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
121.3
From 27 benchmarks. Plenty of data behind it.
Not enough data yet$0.10$0.104KNot enough data yetNot measuredNot measured
Kimi K2 Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
121.0
From 184 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.50131K
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Kimi K2 Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/kimi-k2-instruct-0905 · 0905
121.0
From 184 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.50262K
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Qwen3 235B A22B Instruct 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
120.7
From 258 benchmarks. Plenty of data behind it.
92 ±11
Coding IQ 92.4, 95% interval 82–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22$0.88262K
58.8
Good value (58.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
138
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 VL 235B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/qwen3-vl-235b-a22b-instruct
120.4
From 170 benchmarks. Plenty of data behind it.
≈ 94 ±18
Coding IQ 94.2, 95% interval 76–113. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22$0.88262K
45.0
Poor value (45.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen3 VL 235B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/qwen3-vl-235b-a22b-thinking · thinking
120.4
From 170 benchmarks. Plenty of data behind it.
≈ 94 ±18
Coding IQ 94.2, 95% interval 76–113. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22$0.88262K
45.0
Poor value (45.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen3 Next 80B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/qwen3-next-80b-a3b-thinking · thinking
120.2
From 191 benchmarks. Plenty of data behind it.
90 ±12
Coding IQ 90.0, 95% interval 78–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90$0.904K
51.1
Fair value (51.1). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
MiniMax M2.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
minimax-m2p7
119.8
From 207 benchmarks. Plenty of data behind it.
98 ±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20197K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek V3.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/deepseek-v3p1
119.6
From 122 benchmarks. Plenty of data behind it.
94 ±8
Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.56$1.68128K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
140.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3 235B A22B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
119.3
From 185 benchmarks. Plenty of data behind it.
86 ±12
Coding IQ 86.4, 95% interval 75–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.22$0.88131K
53.2
Good value (53.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
143.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 Coder
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/qwen3-coder-480b-a35b-instruct
119.2
From 84 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 92.6, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45$1.80262K
34.9
Poor value (34.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
39 ±9
Terse (39 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Qwen3 Coder
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/qwen3-coder-480b-instruct-bf16 · bf16
119.2
From 84 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 92.6, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.90$0.90262K
34.9
Poor value (34.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
39 ±9
Terse (39 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
118.9
From 111 benchmarks. Plenty of data behind it.
95 ±7
Coding IQ 95.4, 95% interval 88–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20197K
57.8
Good value (57.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.07$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Run by Fireworks AI

12 listings on this page where Fireworks AI runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks_ai/accounts/fireworks/models/inkling
 Eden AI
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.17$4.051M
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
thinkingmachines/inkling · 🇺🇸 US
 NanoGPT
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.05cache read $0.1785$4.2525Not published by the provider
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
thinkingmachines/inkling:thinking · thinking · 🇺🇸 US
 NanoGPT
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.05cache read $0.1785$4.2525Not published by the provider
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
 Requesty
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20512K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · bf16
 Hugging Face
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.40262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/nemotron-3-ultra-550b-a55b
 OpenRouter
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.40262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks/nemotron-3-ultra-nvfp4 · nvfp4
 Requesty
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.40262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Eden AI
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Hugging Face
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
🇺🇸 US
 NanoGPT
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1575cache read $0.0158$0.63Not published by the provider
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 OpenRouter
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
 Requesty
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works