Skip to content

Listings

All listings: Requesty

Every listing for the models on page 5 of 7 of Requesty, including each model's other versions and routes. Back to Requesty

Sold by Requesty

51 listings on this page sold by Requesty.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Codestral 25.01
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistral/codestral-latest · latest
Inference by Mistral AI
116.6
From 10 benchmarks. A fair amount of data behind it.
Not enough data yet$0.33$0.99131K
37.8
Poor value (37.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Qwen Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
116.4
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$0.40$1.20cache write $0.40131K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Gemini 3.1 Flash Image
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
115.7
From 40 benchmarks. A fair amount of data behind it.
Not enough data yet$0.50$2.00131KNot enough data yetNot measuredNot measured
Qwen3 32B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
115.6
From 234 benchmarks. Plenty of data behind it.
85 ±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.3041K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
115.4
From 375 benchmarks. Plenty of data behind it.
91 ±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
115.4
From 375 benchmarks. Plenty of data behind it.
91 ±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.11$1.761M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@westus3 · 🇺🇸 westus3
Inference by Microsoft Azure
115.4
From 375 benchmarks. Plenty of data behind it.
91 ±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Inference by OpenAI
115.4
From 375 benchmarks. Plenty of data behind it.
91 ±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.055cache read $0.0055$0.44200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.055cache read $0.0055$0.44200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Inference by OpenAI
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40400K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
openai/gpt-5-nano:flex · flex
Inference by OpenAI
115.3
From 332 benchmarks. Plenty of data behind it.
93 ±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.025cache read $0.0025$0.20400K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±9
Typical (51 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium 3.5
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Inference by Mistral AI
115.3
From 173 benchmarks. Plenty of data behind it.
99 ±15
Coding IQ 98.6, 95% interval 84–114. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.65$8.25262K
12.0
Poor value (12.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/qwen/qwen3-30b-a3b-instruct-2507
Inference by Nebius AI Studio
114.9
From 100 benchmarks. Plenty of data behind it.
≈ 86 ±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30128K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistral/mistral-medium-latest · latest
Inference by Mistral AI
114.7
From 48 benchmarks. Plenty of data behind it.
≈ 91 ±14
Coding IQ 90.8, 95% interval 76–105. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44$2.20131K
24.3
Poor value (24.3). Costs more per task than its benchmark results predict. A fair amount of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek V3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by DeepInfra
114.5
From 492 benchmarks. Plenty of data behind it.
85 ±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.85$0.90128K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 ±9
Typical (47 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by Novita AI
114.5
From 492 benchmarks. Plenty of data behind it.
85 ±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.89$0.8964K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 ±9
Typical (47 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3.5 Lightning 30B A3B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by NVIDIA NIM
114.4
From 121 benchmarks. Plenty of data behind it.
92 ±22
Coding IQ 91.7, 95% interval 70–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
——1M
30.6
Poor value (30.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-05-13 · 2024-05-13
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-08-06 · 2024-08-06
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-11-20 · 2024-11-20
Inference by OpenAI
113.7
From 761 benchmarks. Plenty of data behind it.
77 ±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@europe-central2 · 🇵🇱 europe-central2
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@europe-north1 · 🇫🇮 europe-north1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@europe-west1 · 🇧🇪 europe-west1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@europe-west4 · 🇳🇱 europe-west4
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@europe-west8 · 🇮🇹 europe-west8
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@us-central1 · 🇺🇸 us-central1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@us-east1 · 🇺🇸 us-east1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@us-east5 · 🇺🇸 us-east5
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@us-south1 · 🇺🇸 us-south1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Flash-Lite
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared the version names in our catalogue.
vertex/gemini-2.5-flash-lite@us-west1 · 🇺🇸 us-west1
Inference by Google
113.6
From 170 benchmarks. Plenty of data behind it.
≈ 80 ±12
Coding IQ 79.7, 95% interval 68–92. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.40cache write $0.18331M
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 ±9
Chatty (61 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
133
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Devstral Small 2505
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
mistral/devstral-small-latest · latest
Inference by Mistral AI
112.7
From 14 benchmarks. A fair amount of data behind it.
≈ 83 ±10stale
Coding IQ 82.9, 95% interval 73–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.11$0.33131K
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Llama 3.1 405B Instruct
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
deepinfra/meta-llama/Meta-Llama-3.1-405B-Instruct
Inference by DeepInfra
111.8
From 123 benchmarks. Plenty of data behind it.
84 ±9
Coding IQ 84.3, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80$0.80131K
41.9
Poor value (41.9). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Llama 4 Maverick
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
novita/meta-llama/llama-4-maverick-17b-128e-instruct-fp8 · fp8
Inference by Novita AI
111.8
From 350 benchmarks. Plenty of data behind it.
78 ±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.851M
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 ±9
Terse (38 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
111.6
From 56 benchmarks. Plenty of data behind it.
≈ 82 ±14
Coding IQ 81.7, 95% interval 68–95. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.60$6.40cache write $1.6033K
42.6
Poor value (42.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT OSS 20b
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Groq
111.3
From 251 benchmarks. Plenty of data behind it.
88 ±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.50131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Nano 30B A3B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
109.7
From 137 benchmarks. Plenty of data behind it.
91 ±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.20262K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3 Nano 30B A3B
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by NVIDIA NIM
109.7
From 137 benchmarks. Plenty of data behind it.
91 ±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
——262K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Llama 3.3 70B Instruct Turbo
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
≈ 109
From 79 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.12$0.30131K
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen Turbo
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
109.0
From 5 benchmarks. A fair amount of data behind it.
Not enough data yet$0.05$0.20cache write $0.051M
61.6
Good value (61.6). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen2.5 72B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by DeepInfra
108.9
From 216 benchmarks. Plenty of data behind it.
80 ±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.40131K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen2.5 VL 72B Instruct
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
parasail/parasail-qwen25-vl-72b-instruct
Inference by Parasail
108.8
From 97 benchmarks. Plenty of data behind it.
Not enough data yet$0.70$0.7033K
41.2
Poor value (41.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-4o mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-4o-mini@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
108.6
From 478 benchmarks. Plenty of data behind it.
72 ±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-4o-mini@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
108.6
From 478 benchmarks. Plenty of data behind it.
72 ±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.165cache read $0.0825$0.66128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
108.6
From 478 benchmarks. Plenty of data behind it.
72 ±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
108.5
From 365 benchmarks. Plenty of data behind it.
73 ±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30128K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Parasail
108.5
From 365 benchmarks. Plenty of data behind it.
73 ±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$0.50128K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works