Skip to content

Listings

All listings: Requesty

Every listing for the models on page 3 of 7 of Requesty, including each model's other versions and routes. Back to Requesty

Sold by Requesty

70 listings on this page sold by Requesty.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Gemini 3.5 Flash Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
127.5
From 169 benchmarks. Plenty of data behind it.
105 ±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.03$2.501M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.5 Flash Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-3.5-flash-lite@eu · 🇪🇺 eu
Inference by Google
127.5
From 169 benchmarks. Plenty of data behind it.
105 ±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.33cache read $0.033$2.751M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Hy3 (Deep Infra)
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
novita/tencent/hy3
Inference by Novita AI
127.2
From 119 benchmarks. Plenty of data behind it.
111 ±6
Coding IQ 111.3, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.035$0.58262K
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
DeepSeek Reasoner
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepSeek
127.1
From 94 benchmarks. Plenty of data behind it.
101 ±7
Coding IQ 101.4, 95% interval 94–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.028$0.281M
59.4
Good value (59.4). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GLM 4.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
127.0
From 234 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20200K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiMo V2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
127.0
From 145 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 107.8, 95% interval 102–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.08$2.00262K
59.9
Good value (59.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
thinkingmachines/inkling
Inference by Thinking Machines
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.87cache read $0.374$4.6866K
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Inceptron
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.20$3.50256K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Moonshot AI
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.19$4.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Tensorx
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.31$4.50262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Fireworks AI
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20512K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by MiniMax
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.201M
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Tensorx
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$2.001M
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 27B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen 3.8 27BWe compared release dates and version names in our catalogue.
Inference by DeepInfra
125.6
From 331 benchmarks. Plenty of data behind it.
101 ±7
Coding IQ 100.7, 95% interval 94–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.26$2.60262K
42.4
Poor value (42.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
56 ±9
Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Gemini 3.1 Flash Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared release dates and version names in our catalogue.
Inference by Google
125.3
From 275 benchmarks. Plenty of data behind it.
97 ±10
Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.501M
55.5
Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.1 Flash Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared release dates and version names in our catalogue.
vertex/gemini-3.1-flash-lite@eu · 🇪🇺 eu
Inference by Google
125.3
From 275 benchmarks. Plenty of data behind it.
97 ±10
Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$1.651M
55.5
Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.1 Flash Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared release dates and version names in our catalogue.
vertex/gemini-3.1-flash-lite@us · 🇺🇸 us
Inference by Google
125.3
From 275 benchmarks. Plenty of data behind it.
97 ±10
Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$1.651M
55.5
Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
125.2
From 296 benchmarks. Plenty of data behind it.
98 ±13
Coding IQ 98.0, 95% interval 85–111. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00>128k $6.00cache read $0.75$15.00>128k $30.00cache write $3.00256K
32.7
Poor value (32.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
Inference by DeepInfra
125.2
From 157 benchmarks. Plenty of data behind it.
96 ±10
Coding IQ 96.3, 95% interval 86–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.20cache read $0.24$6.00256K
43.3
Poor value (43.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±9
Terse (41 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
142.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by Google
125.0
From 247 benchmarks. Plenty of data behind it.
101 ±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.56cache read $0.056$1.68164K
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepinfra/google/gemma-4-26B-A4B-it
Inference by DeepInfra
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.34262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
novita/google/gemma-4-26b-a4b-it
Inference by Novita AI
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
parasail/google/gemma-4-26B-A4B-it
Inference by Parasail
124.9
From 216 benchmarks. Plenty of data behind it.
102 ±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13cache read $0.05$0.40262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$2.20200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$2.20200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
Inference by OpenAI
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00400K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
openai/gpt-5-mini:flex · flex
Inference by OpenAI
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.125cache read $0.0125$1.00400K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
openai/gpt-5-mini:priority · priority
Inference by OpenAI
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.045$3.60400K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Doubao Seed 1.8deepinfra/ByteDance/Seed-1.8
Inference by DeepInfra
124.4
From 50 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.05$2.00256KNot enough data yetNot measuredNot measured
Qwen 3 235B A22B Thinking 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
124.3
From 161 benchmarks. Plenty of data behind it.
100 ±8stale
Coding IQ 99.6, 95% interval 91–108. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.23cache read $0.20$2.30262K
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Grok 4.3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
124.2
From 205 benchmarks. Plenty of data behind it.
101 ±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.20$2.50>200k $5.00cache write $1.251M
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
doubleword/nvidia-nemotron-3-ultra
Inference by Doubleword
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$2.50262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
doubleword/nvidia-nemotron-3-ultra:flex · flex
Inference by Doubleword
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.37$1.87262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fireworks/nemotron-3-ultra-nvfp4 · nvfp4
Inference by Fireworks AI
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.40262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/nvidia/nemotron-3-ultra-550b-a55b
Inference by Nebius AI Studio
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$3.00128K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/nemotron-3-ultra-550b-a55b
Inference by NVIDIA NIM
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
——1M
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275$4.40200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.3025$4.84200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.3025$4.84200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@westus3 · 🇺🇸 westus3
Inference by Microsoft Azure
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275$4.40200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
123.1
From 174 benchmarks. Plenty of data behind it.
96 ±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.20205K
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
123.1
From 174 benchmarks. Plenty of data behind it.
96 ±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20200K
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Grok 4.1 Fast
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGrok 4.2 FastWe compared the version names in our catalogue.
xai/grok-4-1-fast-non-reasoning · non-reasoning
Inference by xAI
122.9
From 260 benchmarks. Plenty of data behind it.
95 ±14
Coding IQ 95.2, 95% interval 82–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20>128k $0.40cache read $0.05$0.50>128k $1.00cache write $0.202M
59.7
Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
56 ±9
Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Grok 4.1 Fast
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGrok 4.2 FastWe compared the version names in our catalogue.
xai/grok-4-1-fast-reasoning · reasoning
Inference by xAI
122.9
From 260 benchmarks. Plenty of data behind it.
95 ±14
Coding IQ 95.2, 95% interval 82–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20>128k $0.40cache read $0.05$0.50>128k $1.00cache write $0.202M
59.7
Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
56 ±9
Chatty (56 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@eu-central-1 · 🇩🇪 eu-central-1
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$1.44128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@eu-north-1 · 🇸🇪 eu-north-1
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$1.44128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@eu-south-1 · 🇮🇹 eu-south-1
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$1.44128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@eu-west-1 · 🇮🇪 eu-west-1
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$1.44128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@us-east-1 · 🇺🇸 us-east-1
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@us-east-2 · 🇺🇸 us-east-2
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bedrock/minimax-m2.5@us-west-2 · 🇺🇸 us-west-2
Inference by Amazon Web Services
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20128K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by MiniMax
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20200K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
minimaxi/minimax-m2.5-highspeed · highspeed
Inference by MiniMax
122.8
From 192 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.4, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.06$2.40200K
48.7
Fair value (48.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
64 ±9
Chatty (64 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$5.00cache write $1.25200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@ap-northeast-1 · 🇯🇵 ap-northeast-1
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@eu-central-1 · 🇩🇪 eu-central-1
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@eu-north-1 · 🇸🇪 eu-north-1
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@eu-west-1 · 🇮🇪 eu-west-1
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@eu-west-3 · 🇫🇷 eu-west-3
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@us-east-1 · 🇺🇸 us-east-1
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@us-east-2 · 🇺🇸 us-east-2
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
bedrock/claude-haiku-4-5@us-west-2 · 🇺🇸 us-west-2
Inference by Amazon Web Services
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
Inference by Anthropic
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$5.00cache write $1.25200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
Inference by Google
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$5.00cache write $1.25200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
vertex/claude-haiku-4-5@europe-west1 · 🇧🇪 europe-west1
Inference by Google
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Haiku 5.5We compared release dates and version names in our catalogue.
vertex/claude-haiku-4-5@us-east5 · 🇺🇸 us-east5
Inference by Google
122.6
From 470 benchmarks. Plenty of data behind it.
95 ±6
Coding IQ 95.1, 95% interval 90–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.11$5.50cache write $1.375200K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
142.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4 Fast
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGrok 4.2 FastWe compared the version names in our catalogue.
Inference by xAI
122.2
From 239 benchmarks. Plenty of data behind it.
91 ±16
Coding IQ 91.0, 95% interval 75–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20>128k $0.40cache read $0.05$0.50>128k $1.00cache write $0.202M
65.9
Good value (65.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
144.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4 Fast
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGrok 4.2 FastWe compared the version names in our catalogue.
xai/grok-4-fast-non-reasoning · non-reasoning
Inference by xAI
122.2
From 239 benchmarks. Plenty of data behind it.
91 ±16
Coding IQ 91.0, 95% interval 75–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20>128k $0.40cache read $0.05$0.50>128k $1.00cache write $0.202M
65.9
Good value (65.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
144.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works