Skip to content

Listings

All listings: Microsoft Azure

Every listing for the models on page 3 of 13 of Microsoft Azure, including each model's other versions and routes. Back to Microsoft Azure

Sold by Microsoft Azure

53 listings on this page sold by Microsoft Azure.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75200K
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
azure_ai/FW-GLM-5
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.22$3.52200K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Large 4
🇫🇷
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
azure_ai/mistral-large-4-latest · latest
129.6
From 173 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 114.7, 95% interval 108–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.70$2.101M
30.8
Poor value (30.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure_ai/grok-4-20-non-reasoning · non-reasoning
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$2.50262K
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure_ai/grok-4-20-reasoning · reasoning
129.3
From 281 benchmarks. Plenty of data behind it.
108 ±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$2.50262K
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 ±9
Typical (45 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
azure_ai/FW-DeepSeek-V4-Flash
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.311M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
🇦🇺🇧🇷+17 australia-east, brazil-south +23
🇦🇺🇧🇷+17 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
gpt-5.1-codex-batch · batch
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.625$5.00Not published by the provider
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
azure/gpt-5.1-codex-2025-11-13 · 2025-11-13
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
DeepSeek V3.2 Speciale
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
128.6
From 33 benchmarks. Plenty of data behind it.
Not enough data yet$0.58$1.68128K
73.7
Good value (73.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
azure_ai/FW-Kimi-K2.5
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.66cache read $0.11$3.30262K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-0416 · 0416
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50batch $1.00$8.00batch $4.00Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50batch $1.00$8.00batch $4.00200K
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-2025-04-16 · 2025-04-16 · 🇦🇺🇧🇷+17 australia-east, brazil-south +22
o3-2025-04-16 · 2025-04-16 · 🇦🇺🇧🇷+17 australia-east, brazil-south, canada-east, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50batch $1.00$8.00batch $4.00200K
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-2025-04-16 · data-zone+2025-04-16
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.20cache read $0.55$8.80Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-2025-04-16 · regional+2025-04-16
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.20cache read $0.55$8.80Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-2025-04-16-batch · batch+2025-04-16
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$4.00Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
🇦🇺🇧🇷+18 australia-east, brazil-south +24
🇦🇺🇧🇷+18 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, qatar-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075batch $0.375$4.50batch $2.25272K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
data-zone
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.825cache read $0.0825$4.95Not published by the provider
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-5.4-mini-2026-03-17 · 2026-03-17
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075batch $0.375$4.50batch $2.25272K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared release dates and version names in our catalogue.
🇦🇺🇧🇷+17 australia-east, brazil-south +22
🇦🇺🇧🇷+17 australia-east, brazil-south, canada-east, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
127.7
From 21 benchmarks. Plenty of data behind it.
≈ 106 ±9stale
Coding IQ 106.4, 95% interval 98–115. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$1.25cache read $0.125$10.00272K
49.4
Fair value (49.4). Costs per task about what its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Inkling FP4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/FW-Inkling
126.9
From 215 benchmarks. Plenty of data behind it.
102 ±6
Coding IQ 101.9, 95% interval 96–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.19$4.461M
27.9
Poor value (27.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/FW-Kimi-K2.7-Code
126.9
From 102 benchmarks. Plenty of data behind it.
105 ±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.05cache read $0.21$4.40262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
azure_ai/FW-MiniMax-M3
126.8
From 332 benchmarks. Plenty of data behind it.
107 ±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.33cache read $0.066$1.32512K
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$15.00cache read $7.50$60.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o1-preview-2024-09-12 · 2024-09-12 · 🇺🇸🇮🇪+1 us-east-2, europe-north +1
o1-preview-2024-09-12 · 2024-09-12 · 🇺🇸🇮🇪+1 us-east-2, europe-north, sweden-central
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$15.00cache read $7.50$60.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o1-preview-2024-09-12 · regional+2024-09-12
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$16.50cache read $8.25$66.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o1-preview-2024-09-12 · us-eu-data-zone+2024-09-12 · 🇺🇸🇪🇺 us, eu
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$16.50cache read $8.25$66.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o1-preview-batch · batch
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$7.50$30.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Preview
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o1-preview-2024-09-12-batch · batch+2024-09-12
125.5
From 80 benchmarks. Plenty of data behind it.
≈ 87 ±15
Coding IQ 86.5, 95% interval 72–102. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$7.50$30.00Not published by the provider
37.5
Poor value (37.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
133.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
125.2
From 296 benchmarks. Plenty of data behind it.
98 ±13
Coding IQ 98.0, 95% interval 85–111. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00$15.00262K
32.7
Poor value (32.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
azure_ai/FW-DeepSeek-V3.2
125.0
From 247 benchmarks. Plenty of data behind it.
101 ±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.62cache read $0.31$1.85164K
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mai Thinking 1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
124.8
From 17 benchmarks. A fair amount of data behind it.
Not enough data yet$2.00cache read $0.20$8.00256KNot enough data yetNot measuredNot measured
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
🇦🇺🇧🇷+19 australia-east, brazil-south +26
🇦🇺🇧🇷+19 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, italy-north, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, qatar-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025batch $0.125$2.00batch $1.00272K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
data-zone
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$2.20Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
gpt-5-mini-2025-08-07 · 2025-08-07
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.0275batch $0.1375$2.00batch $1.10272K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
gpt-5-mini-batch · batch
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.125$1.00Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
gpt-5-mini-2025-08-07-batch · batch+2025-08-07
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.125$1.00Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionO3 ProWe compared release dates and version names in our catalogue.
124.4
From 11 benchmarks. Plenty of data behind it.
Not enough data yet$150.00cache read $75.00batch $75.00$600.00batch $300.00Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
O1 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionO3 ProWe compared release dates and version names in our catalogue.
o1-pro-batch · batch
124.4
From 11 benchmarks. Plenty of data behind it.
Not enough data yet$75.00$300.00Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Grok 4.3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
124.2
From 205 benchmarks. Plenty of data behind it.
101 ±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.20$2.50>200k $5.00200K
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Nemotron 3 Ultra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/FW-Nemotron-3-Ultra-NVFP4 · nvfp4
124.1
From 172 benchmarks. Plenty of data behind it.
101 ±12
Coding IQ 100.9, 95% interval 89–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.66cache read $0.13$2.64262K
33.1
Poor value (33.1). Costs more per task than its benchmark results predict. A fair amount of data behind it.
53 ±9
Typical (53 ±9). Generates about as many tokens as models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-0416 · 0416
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275batch $0.55$4.40batch $2.20Not published by the provider
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.28batch $0.55$4.40batch $2.20200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-2025-04-16 · 2025-04-16 · 🇦🇺🇧🇷+17 australia-east, brazil-south +24
o4-mini-2025-04-16 · 2025-04-16 · 🇦🇺🇧🇷+17 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, italy-north, japan-east, korea-central, us-north-central, norway-east, poland-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275batch $0.55$4.40batch $2.20200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-2025-04-16 · data-zone+2025-04-16
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.303$4.84Not published by the provider
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-2025-04-16 · regional+2025-04-16
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.303$4.84Not published by the provider
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-batch · batch
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.20Not published by the provider
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o4-mini-2025-04-16-batch · batch+2025-04-16
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.20Not published by the provider
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
🇦🇺🇧🇷+17 australia-east, brazil-south +23
🇦🇺🇧🇷+17 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00272K
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-5.1-codex-mini-batch · batch
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.125$1.00Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-5.1-codex-mini-2025-11-13 · 2025-11-13
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00272K
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Kimi K2 Thinking
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
123.8
From 184 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 100.2, 95% interval 94–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$2.50262K
41.6
Poor value (41.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 ±18
Typical (50 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Run by Microsoft Azure

26 listings on this page where Microsoft Azure runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
global
 OpenRouter
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75200K
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
 Hugging Face
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.21$0.561M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
us
 OpenRouter
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.21cache read $0.031$0.561M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
 Eden AI
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00272K
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
 Llmgateway
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$10.00Not published by the provider
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.1 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
 OpenRouter
129.0
From 31 benchmarks. Plenty of data behind it.
106 ±7
Coding IQ 106.2, 95% interval 99–113. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.13$10.00272K
47.0
Poor value (47.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3
 Llmgateway
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.00Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 Llmgateway
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50Not published by the provider
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 OpenRouter
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 Requesty
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-5.4-mini@eastus2 · 🇺🇸 eastus2
 Requesty
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
 Cortecs AI
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
——400K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
 Llmgateway
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
 OpenRouter
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.03$2.00400K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
 Requesty
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@eastus2 · 🇺🇸 eastus2
 Requesty
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@francecentral · 🇫🇷 francecentral
 Requesty
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$2.20200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
azure/gpt-5-mini@swedencentral · 🇸🇪 swedencentral
 Requesty
124.6
From 388 benchmarks. Plenty of data behind it.
98 ±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.275cache read $0.0275$2.20200K
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 ±9
Terse (40 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 Llmgateway
124.2
From 205 benchmarks. Plenty of data behind it.
101 ±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.50Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 ±9
Typical (48 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@eastus2 · 🇺🇸 eastus2
 Requesty
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275$4.40200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@francecentral · 🇫🇷 francecentral
 Requesty
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.3025$4.84200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@swedencentral · 🇸🇪 swedencentral
 Requesty
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.3025$4.84200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
o4 Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/o4-mini@westus3 · 🇺🇸 westus3
 Requesty
124.0
From 384 benchmarks. Plenty of data behind it.
101 ±14
Coding IQ 100.7, 95% interval 87–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.275$4.40200K
56.2
Good value (56.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±16
Typical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it.
145.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 Eden AI
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00272K
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 Llmgateway
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.1 Codex Mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
 OpenRouter
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.03$2.00272K
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works