Skip to content

Listings

All listings: Requesty

Every listing for the models on page 4 of 7 of Requesty, including each model's other versions and routes. Back to Requesty

Sold by Requesty

61 listings on this page sold by Requesty.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
DeepSeek R1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by DeepInfra
121.9
From 412 benchmarks. Plenty of data behind it.
93 ±14
Coding IQ 92.9, 95% interval 79–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.85$2.5064K
36.1
Poor value (36.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
60 ±11
Chatty (60 ±11). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
140.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by DeepInfra
121.9
From 110 benchmarks. Plenty of data behind it.
95 ±7
Coding IQ 95.3, 95% interval 88–103. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.20131K
41.4
Poor value (41.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
121.9
From 110 benchmarks. Plenty of data behind it.
95 ±7
Coding IQ 95.3, 95% interval 88–103. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20131K
41.4
Poor value (41.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@europe-central2 · 🇵🇱 europe-central2
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@europe-north1 · 🇫🇮 europe-north1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@europe-west1 · 🇧🇪 europe-west1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@europe-west4 · 🇳🇱 europe-west4
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@europe-west8 · 🇮🇹 europe-west8
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@us-central1 · 🇺🇸 us-central1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@us-east1 · 🇺🇸 us-east1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@us-east5 · 🇺🇸 us-east5
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@us-south1 · 🇺🇸 us-south1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
coding/gemini-2.5-flash@us-west1 · 🇺🇸 us-west1
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@europe-central2 · 🇵🇱 europe-central2
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@europe-north1 · 🇫🇮 europe-north1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@europe-west1 · 🇧🇪 europe-west1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@europe-west4 · 🇳🇱 europe-west4
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@europe-west8 · 🇮🇹 europe-west8
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@us-central1 · 🇺🇸 us-central1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@us-east1 · 🇺🇸 us-east1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@us-east5 · 🇺🇸 us-east5
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@us-south1 · 🇺🇸 us-south1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared the version names in our catalogue.
vertex/gemini-2.5-flash@us-west1 · 🇺🇸 us-west1
Inference by Google
121.6
From 327 benchmarks. Plenty of data behind it.
86 ±16
Coding IQ 85.5, 95% interval 70–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.075$2.50cache write $0.551M
39.0
Poor value (39.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 35B A3B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen3.6 35B A3BWe compared release dates and version names in our catalogue.
Inference by DeepInfra
121.1
From 311 benchmarks. Plenty of data behind it.
95 ±8
Coding IQ 95.0, 95% interval 87–103. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.05$1.00262K
40.3
Poor value (40.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2 Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
121.0
From 184 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.57$2.30131K
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.001M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-4.1@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.001M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-4.1@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.20cache read $0.55$8.801M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-4.1@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.20cache read $0.55$8.801M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-4.1@westus3 · 🇺🇸 westus3
Inference by Microsoft Azure
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.001M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
120.7
From 486 benchmarks. Plenty of data behind it.
92 ±6
Coding IQ 92.4, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.001M
42.8
Poor value (42.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
33 ±8
Terse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 235B A22B Instruct 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
120.7
From 258 benchmarks. Plenty of data behind it.
92 ±11
Coding IQ 92.4, 95% interval 82–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.071$0.10262K
58.8
Good value (58.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
138
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 235B A22B Instruct 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
120.7
From 258 benchmarks. Plenty of data behind it.
92 ±11
Coding IQ 92.4, 95% interval 82–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.60128K
58.8
Good value (58.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
138
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 235B A22B Instruct 2507
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
parasail/parasail-qwen3-235b-a22b-instruct-2507
Inference by Parasail
120.7
From 258 benchmarks. Plenty of data behind it.
92 ±11
Coding IQ 92.4, 95% interval 82–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.85262K
58.8
Good value (58.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
138
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 3 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
120.4
From 190 benchmarks. Plenty of data behind it.
≈ 95 ±12
Coding IQ 94.5, 95% interval 82–107. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$0.50131K
50.6
Fair value (50.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
139.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 3 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
xai/grok-3-mini:high · high
Inference by xAI
120.4
From 190 benchmarks. Plenty of data behind it.
≈ 95 ±12
Coding IQ 94.5, 95% interval 82–107. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$0.50131K
50.6
Fair value (50.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
139.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 3 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
xai/grok-3-mini:low · low
Inference by xAI
120.4
From 190 benchmarks. Plenty of data behind it.
≈ 95 ±12
Coding IQ 94.5, 95% interval 82–107. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$0.50131K
50.6
Fair value (50.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measured
139.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.4 Nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
120.3
From 252 benchmarks. Plenty of data behind it.
104 ±6
Coding IQ 103.6, 95% interval 97–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.02$1.25400K
49.5
Fair value (49.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
47 ±9
Typical (47 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Step 3.7 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
120.2
From 41 benchmarks. Plenty of data behind it.
106 ±15
Coding IQ 105.6, 95% interval 90–121. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.04$1.15262K
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Gemini 3 Pro Image
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
119.8
From 189 benchmarks. A fair amount of data behind it.
Not enough data yet$2.00cache read $0.20$12.00cache write $4.501MNot enough data yetNot measuredNot measured
MiniMax M2.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by MiniMax
119.8
From 207 benchmarks. Plenty of data behind it.
98 ±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20200K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
minimaxi/minimax-m2.7-highspeed · highspeed
Inference by MiniMax
119.8
From 207 benchmarks. Plenty of data behind it.
98 ±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.06$2.40cache write $1.20200K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
119.8
From 207 benchmarks. Plenty of data behind it.
98 ±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20200K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.7
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
novita/minimax/minimax-m2.7-highspeed · highspeed
Inference by Novita AI
119.8
From 207 benchmarks. Plenty of data behind it.
98 ±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.40205K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek V3.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
119.6
From 122 benchmarks. Plenty of data behind it.
94 ±8
Coding IQ 94.3, 95% interval 86–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.00164K
44.0
Poor value (44.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
140.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen 3 235B A22B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
119.3
From 185 benchmarks. Plenty of data behind it.
86 ±12
Coding IQ 86.4, 95% interval 75–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.6041K
53.2
Good value (53.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
143.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 Coder
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepinfra/Qwen/Qwen3-Coder-480B-A35B-Instruct
Inference by DeepInfra
119.2
From 84 benchmarks. Plenty of data behind it.
93 ±6
Coding IQ 92.6, 95% interval 87–98. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$1.60262K
34.9
Poor value (34.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
39 ±9
Terse (39 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by MiniMax
118.9
From 111 benchmarks. Plenty of data behind it.
95 ±7
Coding IQ 95.4, 95% interval 88–103. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20200K
57.8
Good value (57.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Hermes 4 405B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
118.8
From 7 benchmarks. A fair amount of data behind it.
Not enough data yet$1.00$3.00128K
38.3
Poor value (38.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3 Nano Omni 30b A3b Reasoning
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by NVIDIA NIM
≈ 119
From 3 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet——131KNot enough data yetNot measuredNot measured
Inference by DeepInfra
118.6
From 76 benchmarks. Plenty of data behind it.
Not enough data yet$0.10cache read $0.02$0.40256K
45.0
Poor value (45.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Grok Code Fast 1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
118.4
From 31 benchmarks. Plenty of data behind it.
89 ±8
Coding IQ 88.7, 95% interval 81–96. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.02$1.50256K
52.1
Fair value (52.1). Costs per task about what its benchmark results predict. A fair amount of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Fireworks AI
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Groq
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.75131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
118.2
From 424 benchmarks. Plenty of data behind it.
86 ±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 ±11
Terse (37 ±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
118.2
From 188 benchmarks. Plenty of data behind it.
≈ 91 ±10stale
Coding IQ 90.7, 95% interval 80–101. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$5.00$25.00131K
34.0
Poor value (34.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
137.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek Chat
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepSeek
118.1
From 32 benchmarks. Plenty of data behind it.
Not enough data yet$0.14cache read $0.028$0.281M
45.0
Poor value (45.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
GLM 4.5 Air
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
118.0
From 210 benchmarks. Plenty of data behind it.
93 ±7
Coding IQ 93.2, 95% interval 86–100. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$1.10131K
42.6
Poor value (42.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Nemotron 3 Super 120B A12B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionNemotron 3.5 Super 120B A12BWe compared the version names in our catalogue.
deepinfra/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B
Inference by DeepInfra
117.3
From 151 benchmarks. Plenty of data behind it.
98 ±20
Coding IQ 98.4, 95% interval 79–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.50262KNot enough data yetNot measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works