Listings
All listings: Requesty
Every listing for the models on page 3 of 7 of Requesty, including each model's other versions and routes. Back to Requesty
Sold by Requesty
70 listings on this page sold by Requesty.
Select a score for details.
About these columns
- llminfo IQ
- llminfo IQ (capability index). How llminfo IQ is computed
- Coding IQ
- llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
- Value
- Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
- Yap
- Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
- Epoch Capabilities Index
- Epoch Capabilities Index benchmark details
| Model | llminfo IQ | Coding IQ | Input $/1M | Output $/1M | Max Input Tokens | Value | Yap | Epoch Capabilities Index |
|---|---|---|---|---|---|---|---|---|
Gemini 3.5 Flash Lite Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 127.5From 169 benchmarks. Plenty of data behind it. | 105 ±6Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.03 | $2.50 | 1M | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemini 3.5 Flash Lite Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 127.5From 169 benchmarks. Plenty of data behind it. | 105 ±6Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.33cache read $0.033 | $2.75 | 1M | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Hy3 (Deep Infra) Inference by Novita AI🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 127.2From 119 benchmarks. Plenty of data behind it. | 111 ±6Coding IQ 111.3, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.14cache read $0.035 | $0.58 | 262K | 52.3Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate. | —Not measured | —Not measured |
DeepSeek Reasoner Inference by DeepSeek🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 127.1From 94 benchmarks. Plenty of data behind it. | 101 ±7Coding IQ 101.4, 95% interval 94–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.14cache read $0.028 | $0.28 | 1M | 59.4Good value (59.4). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | —Not measured | —Not measured |
GLM 4.7 Inference by Z.ai🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 127.0From 234 benchmarks. Plenty of data behind it. | 104 ±5Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.11 | $2.20 | 200K | 41.0Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 61 ±9Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 143.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
MiMo V2.5 Inference by DeepInfra🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 127.0From 145 benchmarks. Plenty of data behind it. | 108 ±6Coding IQ 107.8, 95% interval 102–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.40cache read $0.08 | $2.00 | 262K | 59.9Good value (59.9). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 55 ±9Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Inkling FP4 Inference by Thinking Machines🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 215 benchmarks. Plenty of data behind it. | 102 ±6Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.87cache read $0.374 | $4.68 | 66K | 27.9Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it. | 58 ±9Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 148.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Kimi K2.7 Code Inference by Inceptron🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 102 benchmarks. Plenty of data behind it. | 105 ±9Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.75cache read $0.20 | $3.50 | 256K | 43.6Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 62 ±9Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 151.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Kimi K2.7 Code Inference by Moonshot AI🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 102 benchmarks. Plenty of data behind it. | 105 ±9Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.95cache read $0.19 | $4.00 | 262K | 43.6Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 62 ±9Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 151.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Kimi K2.7 Code Inference by Tensorx🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 126.9From 102 benchmarks. Plenty of data behind it. | 105 ±9Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.25cache read $0.31 | $4.50 | 262K | 43.6Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it. | 62 ±9Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 151.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
MiniMax M3 Inference by Fireworks AI🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 126.8From 332 benchmarks. Plenty of data behind it. | 107 ±9Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 512K | 50.9Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it. | 71 ±8Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 147.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
MiniMax M3 Inference by MiniMax🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 126.8From 332 benchmarks. Plenty of data behind it. | 107 ±9Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 1M | 50.9Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it. | 71 ±8Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 147.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
MiniMax M3 Inference by Tensorx🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. | 126.8From 332 benchmarks. Plenty of data behind it. | 107 ±9Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.40cache read $0.10 | $2.00 | 1M | 50.9Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it. | 71 ±8Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 147.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Qwen3.5 27B Inference by DeepInfra🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 125.6From 331 benchmarks. Plenty of data behind it. | 101 ±7Coding IQ 100.7, 95% interval 94–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.26 | $2.60 | 262K | 42.4Poor value (42.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 56 ±9Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Gemini 3.1 Flash Lite Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 125.3From 275 benchmarks. Plenty of data behind it. | 97 ±10Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.25cache read $0.025 | $1.50 | 1M | 55.5Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemini 3.1 Flash Lite Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 125.3From 275 benchmarks. Plenty of data behind it. | 97 ±10Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.275cache read $0.0275 | $1.65 | 1M | 55.5Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemini 3.1 Flash Lite Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 125.3From 275 benchmarks. Plenty of data behind it. | 97 ±10Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.275cache read $0.0275 | $1.65 | 1M | 55.5Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 145Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Grok 4 Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 125.2From 296 benchmarks. Plenty of data behind it. | 98 ±13Coding IQ 98.0, 95% interval 85–111. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $3.00>128k $6.00cache read $0.75 | $15.00>128k $30.00cache write $3.00 | 256K | 32.7Poor value (32.7). Costs more per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 146.9Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
125.2From 157 benchmarks. Plenty of data behind it. | 96 ±10Coding IQ 96.3, 95% interval 86–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.20cache read $0.24 | $6.00 | 256K | 43.3Poor value (43.3). Costs more per task than its benchmark results predict. Plenty of data behind it. | 41 ±9Terse (41 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 142.4Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API | |
DeepSeek V3.2 Inference by Google🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 125.0From 247 benchmarks. Plenty of data behind it. | 101 ±7Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.56cache read $0.056 | $1.68 | 164K | 63.8Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 146.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 4 26B A4B Inference by DeepInfra🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.9From 216 benchmarks. Plenty of data behind it. | 102 ±8Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.07 | $0.34 | 262K | 56.4Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 141.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 4 26B A4B Inference by Novita AI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.9From 216 benchmarks. Plenty of data behind it. | 102 ±8Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.13 | $0.40 | 262K | 56.4Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 141.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 4 26B A4B Inference by Parasail🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.9From 216 benchmarks. Plenty of data behind it. | 102 ±8Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.13cache read $0.05 | $0.40 | 262K | 56.4Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it. | 50 ±9Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 141.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.25cache read $0.025 | $2.00 | 200K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.25cache read $0.025 | $2.00 | 200K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.275cache read $0.0275 | $2.20 | 200K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.275cache read $0.0275 | $2.20 | 200K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by OpenAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.25cache read $0.025 | $2.00 | 400K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by OpenAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.125cache read $0.0125 | $1.00 | 400K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-5 mini Inference by OpenAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 124.6From 388 benchmarks. Plenty of data behind it. | 98 ±14Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.45cache read $0.045 | $3.60 | 400K | 55.1Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 40 ±9Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | 146Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Doubao Seed 1.8deepinfra/ByteDance/Seed-1.8deepinfra/ByteDance/Seed-1.8 Inference by DeepInfra | 124.4From 50 benchmarks. Plenty of data behind it. | —Not enough data yet | $0.25cache read $0.05 | $2.00 | 256K | —Not enough data yet | —Not measured | —Not measured |
Qwen 3 235B A22B Thinking 2507 Inference by DeepInfra🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.3From 161 benchmarks. Plenty of data behind it. | 100 ±8staleCoding IQ 99.6, 95% interval 91–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old. | $0.23cache read $0.20 | $2.30 | 262K | 40.6Poor value (40.6). Costs more per task than its benchmark results predict. A fair amount of data behind it. | —Not measured | —Not measured |
Grok 4.3 Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 124.2From 205 benchmarks. Plenty of data behind it. | 101 ±8Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.25>200k $2.50cache read $0.20 | $2.50>200k $5.00cache write $1.25 | 1M | 39.3Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Nemotron 3 Ultra Inference by Doubleword🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.50 | $2.50 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Nemotron 3 Ultra Inference by Doubleword🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.37 | $1.87 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Nemotron 3 Ultra Inference by Fireworks AI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.12 | $2.40 | 262K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Nemotron 3 Ultra Inference by Nebius AI Studio🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00 | $3.00 | 128K | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Nemotron 3 Ultra Inference by NVIDIA NIM🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 124.1From 172 benchmarks. Plenty of data behind it. | 101 ±12Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | — | — | 1M | 33.1Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it. | 53 ±9Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate. | 147Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
o4 Mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 124.0From 384 benchmarks. Plenty of data behind it. | 101 ±14Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.275 | $4.40 | 200K | 56.2Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 53 ±16Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it. | 145.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
o4 Mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 124.0From 384 benchmarks. Plenty of data behind it. | 101 ±14Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.21cache read $0.3025 | $4.84 | 200K | 56.2Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 53 ±16Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it. | 145.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
o4 Mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 124.0From 384 benchmarks. Plenty of data behind it. | 101 ±14Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.21cache read $0.3025 | $4.84 | 200K | 56.2Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 53 ±16Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it. | 145.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
o4 Mini Inference by Microsoft Azure🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. | 124.0From 384 benchmarks. Plenty of data behind it. | 101 ±14Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.275 | $4.40 | 200K | 56.2Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 53 ±16Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it. | 145.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GLM 4.6 Inference by Novita AI🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 123.1From 174 benchmarks. Plenty of data behind it. | 96 ±22Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60 | $2.20 | 205K | 46.8Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
GLM 4.6 Inference by Z.ai🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 123.1From 174 benchmarks. Plenty of data behind it. | 96 ±22Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.11 | $2.20 | 200K | 46.8Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | 48 ±9Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Grok 4.1 Fast Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.9From 260 benchmarks. Plenty of data behind it. | 95 ±14Coding IQ 95.2, 95% interval 82–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.20>128k $0.40cache read $0.05 | $0.50>128k $1.00cache write $0.20 | 2M | 59.7Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 56 ±9Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Grok 4.1 Fast Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.9From 260 benchmarks. Plenty of data behind it. | 95 ±14Coding IQ 95.2, 95% interval 82–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.20>128k $0.40cache read $0.05 | $0.50>128k $1.00cache write $0.20 | 2M | 59.7Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it. | 56 ±9Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.36 | $1.44 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.36 | $1.44 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.36 | $1.44 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.36 | $1.44 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30 | $1.20 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30 | $1.20 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by Amazon Web Services🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30 | $1.20 | 128K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by MiniMax🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.30cache read $0.06 | $1.20 | 200K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
MiniMax M2.5 Inference by MiniMax🇨🇳Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 122.8From 192 benchmarks. Plenty of data behind it. | 100 ±6Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.60cache read $0.06 | $2.40 | 200K | 48.7Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it. | 64 ±9Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | —Not measured |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00cache read $0.10 | $5.00cache write $1.25 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Amazon Web Services🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Anthropic🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00cache read $0.10 | $5.00cache write $1.25 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.00cache read $0.10 | $5.00cache write $1.25 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Claude Haiku 4.5 Inference by Google🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.6From 470 benchmarks. Plenty of data behind it. | 95 ±6Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $1.10cache read $0.11 | $5.50cache write $1.375 | 200K | 35.0Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 ±10Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it. | 142.7Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Grok 4 Fast Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.2From 239 benchmarks. Plenty of data behind it. | 91 ±16Coding IQ 91.0, 95% interval 75–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.20>128k $0.40cache read $0.05 | $0.50>128k $1.00cache write $0.20 | 2M | 65.9Good value (65.9). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 144.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Grok 4 Fast Inference by xAI🇺🇸Maker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 122.2From 239 benchmarks. Plenty of data behind it. | 91 ±16Coding IQ 91.0, 95% interval 75–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.20>128k $0.40cache read $0.05 | $0.50>128k $1.00cache write $0.20 | 2M | 65.9Good value (65.9). Cheaper per task than its benchmark results predict. Plenty of data behind it. | —Not measured | 144.3Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)