Listings
All listings: Fireworks AI
Every listing for the models on page 2 of 13 of Fireworks AI, including each model's other versions and routes. Back to Fireworks AI
Sold by Fireworks AI
30 listings on this page sold by Fireworks AI.
Select a score for details.
About these columns
- llminfo IQ
- llminfo IQ (capability index). How llminfo IQ is computed
- Coding IQ
- llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
- Value
- Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
- Yap
- Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
- Epoch Capabilities Index
- Epoch Capabilities Index benchmark details
| Model | llminfo IQ | Coding IQ | Input $/1M | Output $/1M | Max Input Tokens | Value | Yap | Epoch Capabilities Index |
|---|---|---|---|---|---|---|---|---|
GLM 4.7 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 127.0From 234 benchmarks. Plenty of data behind it. | 104 ±5Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.30 | $2.20 | 203K | 41.0Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 61 ±9Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 143.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Inkling FP4 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 215 benchmarks. Plenty of data behind it. | 102 ±6Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00cache read $0.17 | $4.05 | 1M | 27.9Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 58 ±9Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 148.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Kimi K2.7 Code 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 102 benchmarks. Plenty of data behind it. | 105 ±9Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.95cache read $0.19 | $4.00 | 262K | 43.6Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 62 ±9Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 151.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Kimi K2.7 Code 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 102 benchmarks. Plenty of data behind it. | 105 ±9Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.90cache read $0.38 | $8.00 | 262K | 43.6Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 62 ±9Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 151.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
MiniMax M3 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 126.8From 332 benchmarks. Plenty of data behind it. | 107 ±9Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 512K | 50.9Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it. | 71 ±8Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 147.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
DeepSeek V3.2 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 125.0From 247 benchmarks. Plenty of data behind it. | 101 ±7Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.56cache read $0.28 | $1.68 | 164K | 63.8Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 146.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen 3 235B A22B Thinking 2507 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.3From 161 benchmarks. Plenty of data behind it. | 100 ±8staleCoding IQ 99.6, 95% interval 91–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old. | $0.22 | $0.88 | 262K | 40.6Poor value (40.6). Costs more per task than its benchmark results predict. A fair amount of data behind it. | —Not measured | —Not measured |
Nemotron 3 Ultra 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.12 | $2.40 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen3 Embedding 4B 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 196 benchmarks. Plenty of data behind it. | —Not enough data yet | — | — | 41K | —Not enough data yet | —Not measured | —Not measured |
Kimi K2 Thinking 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 123.8From 184 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.2, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60 | $2.50 | 262K | 41.6Poor value (41.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 50 ±18Typical (50 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145.5Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GLM 4.6 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 123.1From 174 benchmarks. Plenty of data behind it. | 96 ±22Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.55 | $2.19 | 203K | 46.8Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.1 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.3From 97 benchmarks. Plenty of data behind it. | 97 ±6Coding IQ 96.5, 95% interval 91–102. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.03 | $1.20 | 197K | 45.1Poor value (45.1). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±13Chatty (59 ±13). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
DeepSeek R1 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 121.9From 412 benchmarks. Plenty of data behind it. | 93 ±14Coding IQ 92.9, 95% interval 79–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $3.00 | $8.00 | 164K | 36.1Poor value (36.1). Costs more per task than its benchmark results predict. Plenty of data behind it. | 60 ±11Chatty (60 ±11). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 140.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
DeepSeek R1 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 121.9From 412 benchmarks. Plenty of data behind it. | 93 ±14Coding IQ 92.9, 95% interval 79–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $3.00 | $8.00 | 164K | 36.1Poor value (36.1). Costs more per task than its benchmark results predict. Plenty of data behind it. | 60 ±11Chatty (60 ±11). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 140.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GLM 4.5 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 121.9From 110 benchmarks. Plenty of data behind it. | 95 ±7Coding IQ 95.3, 95% interval 88–103. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.55 | $2.19 | 131K | 41.4Poor value (41.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
DeepSeek V3.1 Terminus 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 121.4From 57 benchmarks. Plenty of data behind it. | ≈ 99 ±13Coding IQ 99.4, 95% interval 86–112. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.56 | $1.68 | 128K | 57.6Good value (57.6). Cheaper per task than its benchmark results predict. A fair amount of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M1 80K 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 121.3From 27 benchmarks. Plenty of data behind it. | —Not enough data yet | $0.10 | $0.10 | 4K | —Not enough data yet | —Not measured | —Not measured |
Kimi K2 Instruct 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 121.0From 184 benchmarks. Plenty of data behind it. | 93 ±6Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60 | $2.50 | 131K | 50.2Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it. | —Not measured | —Not measured |
Kimi K2 Instruct 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 121.0From 184 benchmarks. Plenty of data behind it. | 93 ±6Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60 | $2.50 | 262K | 50.2Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it. | —Not measured | —Not measured |
Qwen3 235B A22B Instruct 2507 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 120.7From 258 benchmarks. Plenty of data behind it. | 92 ±11Coding IQ 92.4, 95% interval 82–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.22 | $0.88 | 262K | 58.8Good value (58.8). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 138Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen3 VL 235B 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 120.4From 170 benchmarks. Plenty of data behind it. | ≈ 94 ±18Coding IQ 94.2, 95% interval 76–113. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.22 | $0.88 | 262K | 45.0Poor value (45.0). Costs more per task than its benchmark results predict. A fair amount of data behind it. | —Not measured | —Not measured |
Qwen3 VL 235B 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 120.4From 170 benchmarks. Plenty of data behind it. | ≈ 94 ±18Coding IQ 94.2, 95% interval 76–113. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.22 | $0.88 | 262K | 45.0Poor value (45.0). Costs more per task than its benchmark results predict. A fair amount of data behind it. | —Not measured | —Not measured |
Qwen3 Next 80B A3B 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 120.2From 191 benchmarks. Plenty of data behind it. | 90 ±12Coding IQ 90.0, 95% interval 78–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.90 | $0.90 | 4K | 51.1Fair value (51.1). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate. | —Not measured | —Not measured |
MiniMax M2.7 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 119.8From 207 benchmarks. Plenty of data behind it. | 98 ±12Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 197K | 50.7Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 61 ±9Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
DeepSeek V3.1 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 119.6From 122 benchmarks. Plenty of data behind it. | 94 ±8Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.56 | $1.68 | 128K | 44.0Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 140.9Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen 3 235B A22B 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 119.3From 185 benchmarks. Plenty of data behind it. | 86 ±12Coding IQ 86.4, 95% interval 75–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.22 | $0.88 | 131K | 53.2Good value (53.2). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 143.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen3 Coder 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 119.2From 84 benchmarks. Plenty of data behind it. | 93 ±6Coding IQ 92.6, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.45 | $1.80 | 262K | 34.9Poor value (34.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 39 ±9Terse (39 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Qwen3 Coder 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 119.2From 84 benchmarks. Plenty of data behind it. | 93 ±6Coding IQ 92.6, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.90 | $0.90 | 262K | 34.9Poor value (34.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 39 ±9Terse (39 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.9From 111 benchmarks. Plenty of data behind it. | 95 ±7Coding IQ 95.4, 95% interval 88–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30 | $1.20 | 197K | 57.8Good value (57.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it. | —Not measured | —Not measured |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.07 | $0.60 | 131K | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Run by Fireworks AI
12 listings on this page where Fireworks AI runs the model. Another provider sells these listings.
Select a score for details.
About these columns
- llminfo IQ
- llminfo IQ (capability index). How llminfo IQ is computed
- Coding IQ
- llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
- Value
- Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
- Yap
- Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
- Epoch Capabilities Index
- Epoch Capabilities Index benchmark details
| Model | Provider | llminfo IQ | Coding IQ | Input $/1M | Output $/1M | Max Input Tokens | Value | Yap | Epoch Capabilities Index |
|---|---|---|---|---|---|---|---|---|---|
Inkling FP4 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 215 benchmarks. Plenty of data behind it. | 102 ±6Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00cache read $0.17 | $4.05 | 1M | 27.9Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 58 ±9Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 148.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
Inkling FP4 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 215 benchmarks. Plenty of data behind it. | 102 ±6Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.05cache read $0.1785 | $4.2525 | —Not published by the provider | 27.9Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 58 ±9Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 148.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
Inkling FP4 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 215 benchmarks. Plenty of data behind it. | 102 ±6Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.05cache read $0.1785 | $4.2525 | —Not published by the provider | 27.9Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 58 ±9Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 148.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
MiniMax M3 🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 126.8From 332 benchmarks. Plenty of data behind it. | 107 ±9Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 512K | 50.9Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it. | 71 ±8Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 147.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
Nemotron 3 Ultra 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60 | $2.40 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
Nemotron 3 Ultra 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.12 | $2.40 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
Nemotron 3 Ultra 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.12 | $2.40 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.015 | $0.60 | 131K | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15 | $0.60 | 131K | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.1575cache read $0.0158 | $0.63 | —Not published by the provider | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.015 | $0.60 | 131K | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
GPT OSS 120B 🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 118.2From 424 benchmarks. Plenty of data behind it. | 86 ±5Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.015 | $0.60 | 131K | 58.4Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 37 ±11Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 140.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)