Skip to content

Listings

All listings: Microsoft Azure

Every listing for the models on page 5 of 13 of Microsoft Azure, including each model's other versions and routes. Back to Microsoft Azure

Sold by Microsoft Azure

67 listings on this page sold by Microsoft Azure.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Codestral 25.01
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
2501
116.6
From 10 benchmarks. A fair amount of data behind it.
Not enough data yet$0.30$0.90256K
37.8
Poor value (37.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MAI-Image-2.6
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionMAI Image 2.7We compared the version names in our catalogue.
β‰ˆ 117
From 15 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$5.00β€”32KNot enough data yetNot measuredNot measured
Mistral Large 3
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionMistral Large 4We compared release dates and version names in our catalogue.
116.5
From 105 benchmarks. Plenty of data behind it.
Not enough data yet$0.50$1.50256K
56.3
Good value (56.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-4 Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
πŸ‡¦πŸ‡ΊπŸ‡¨πŸ‡¦+8 australia-east, canada-east +15
πŸ‡¦πŸ‡ΊπŸ‡¨πŸ‡¦+8 australia-east, canada-east, us-east, us-east-2, france-central, us-north-central, norway-east, us-south-central, south-india, sweden-central, switzerland-north, united-kingdom-south, usgov-arizona, usgov-virginia, europe-west, us-west, us-west-3
116.2
From 380 benchmarks. Plenty of data behind it.
83Β Β±10
Coding IQ 83.0, 95% interval 73–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$11.00$33.00128K
34.4
Poor value (34.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
125.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4 Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4-turbo-2024-04-09 Β· 2024-04-09
116.2
From 380 benchmarks. Plenty of data behind it.
83Β Β±10
Coding IQ 83.0, 95% interval 73–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$10.00$30.00128K
34.4
Poor value (34.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
125.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4 Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4-turbo-batch Β· batch
116.2
From 380 benchmarks. Plenty of data behind it.
83Β Β±10
Coding IQ 83.0, 95% interval 73–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00$15.00Not published by the provider
34.4
Poor value (34.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
125.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4 Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4-turbo-2024-04-09-batch Β· batch+2024-04-09
116.2
From 380 benchmarks. Plenty of data behind it.
83Β Β±10
Coding IQ 83.0, 95% interval 73–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00$15.00Not published by the provider
34.4
Poor value (34.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
125.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10batch $0.20$1.60batch $0.801M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
gpt-4.1-mini-2025-04-14 Β· 2025-04-14 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south +26
gpt-4.1-mini-2025-04-14 Β· 2025-04-14 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, italy-north, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-2, us-west-3
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10batch $0.20$1.60batch $0.801M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
gpt-4.1-mini-2025-04-14 Β· data-zone+2025-04-14
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.11$1.76Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
gpt-4.1-mini-2025-04-14 Β· regional+2025-04-14
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.11$1.76Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
gpt-4.1-mini-batch Β· batch
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.80Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
gpt-4.1-mini-2025-04-14-batch Β· batch+2025-04-14
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.80Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south +25
πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, italy-north, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005batch $0.025$0.40batch $0.20272K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
data-zone
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.055cache read $0.0055$0.44Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
gpt-5-nano-2025-08-07 Β· 2025-08-07
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.0055batch $0.0275$0.40batch $0.22272K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
gpt-5-nano-batch Β· batch
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.025$0.20Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
gpt-5-nano-2025-08-07-batch Β· batch+2025-08-07
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.025$0.20Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Medium 3.5
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
115.3
From 173 benchmarks. Plenty of data behind it.
99Β Β±15
Coding IQ 98.6, 95% interval 84–114. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50$7.50128K
12.0
Poor value (12.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.55batch $0.55$4.40batch $2.20128K
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
o1-mini-2024-09-12 Β· 2024-09-12 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+17 australia-east, brazil-south +24
o1-mini-2024-09-12 Β· 2024-09-12 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+17 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3, us-west-2
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.10cache read $0.55batch $0.55$4.40batch $2.20128K
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
o1-mini-2024-09-12 Β· regional+2024-09-12
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.605$4.84Not published by the provider
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
o1-mini-2024-09-12 Β· us-eu-data-zone+2024-09-12 Β· πŸ‡ΊπŸ‡ΈπŸ‡ͺπŸ‡Ί us, eu
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.21cache read $0.605$4.84Not published by the provider
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
o1-mini-batch Β· batch
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.20Not published by the provider
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O1 Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versiono4 MiniWe compared release dates and version names in our catalogue.
o1-mini-2024-09-12-batch Β· batch+2024-09-12
115.3
From 187 benchmarks. Plenty of data behind it.
83Β Β±14
Coding IQ 82.8, 95% interval 69–97. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55$2.20Not published by the provider
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Command A
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/cohere-command-a
115.1
From 61 benchmarks. A fair amount of data behind it.
Not enough data yet$2.50$10.00131K
31.8
Poor value (31.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Command A Plus 05 2026
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/Cohere-command-a-plus-05-2026
114.7
From 25 benchmarks. Plenty of data behind it.
Not enough data yet$0.80$3.20128K
21.9
Poor value (21.9). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
DeepSeek V3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
azure_ai/deepseek-v3-0324 Β· 0324
114.5
From 492 benchmarks. Plenty of data behind it.
85Β Β±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.14$4.56Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 Β±9
Typical (47 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3.5 Lightning 30B A3B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/FW-Nemotron-Lightning-3.5-30B-A3B
114.4
From 121 benchmarks. Plenty of data behind it.
92Β Β±22
Coding IQ 91.7, 95% interval 70–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.01$0.22262K
30.6
Poor value (30.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-0513 Β· 0513
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00batch $2.50$15.00batch $7.50Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-0806 Β· 0806
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25batch $1.25$10.00batch $5.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-1120 Β· 1120
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25batch $1.25$10.00batch $5.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.375batch $1.375$10.00batch $5.50128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-08-06 Β· 2024-08-06 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+17 australia-east, brazil-south +24
gpt-4o-2024-08-06 Β· 2024-08-06 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+17 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-3
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25batch $1.375$10.00batch $5.50128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-08-06 Β· regional+2024-08-06
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.75cache read $1.375$11.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-08-06 Β· us-eu-data-zone+2024-08-06 Β· πŸ‡ΊπŸ‡ΈπŸ‡ͺπŸ‡Ί us, eu
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.75cache read $1.375$11.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-05-13 Β· 2024-05-13
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00batch $2.50$15.00batch $7.50128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-11-20 Β· 2024-11-20
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.375batch $1.375$10.00batch $5.50128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-batch Β· batch
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$5.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-05-13-batch Β· batch+2024-05-13
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50$7.50Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-08-06-batch Β· batch+2024-08-06
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$5.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-2024-11-20-batch Β· batch+2024-11-20
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$5.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mai Image 2.5
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionMAI Image 2.7We compared the version names in our catalogue.
113.6
From 15 benchmarks. A fair amount of data behind it.
Not enough data yet$5.00β€”32KNot enough data yetNot measuredNot measured
Mistral Medium 3
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
azure_ai/mistral-medium-2505
113.0
From 33 benchmarks. Plenty of data behind it.
Not enough data yet$0.40$2.00131K
42.0
Poor value (42.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Llama 4 Maverick
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/Llama-4-Maverick-17B-128E-Instruct-FP8 Β· fp8
111.8
From 350 benchmarks. Plenty of data behind it.
78Β Β±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25$1.001M
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 Β±9
Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+14 australia-east, brazil-south +20
πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+14 australia-east, brazil-south, canada-central, canada-east, us-east, us-east-2, france-central, germany-west-central, japan-east, us-north-central, europe-north, norway-east, poland-central, us-south-central, south-india, spain-central, sweden-central, switzerland-north, united-kingdom-south, europe-west, us-west, us-west-3
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
gpt-4-0314 Β· 0314
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
gpt-4-0613 Β· 0613
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
gpt-4-batch Β· batch
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$15.00$30.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
gpt-4-0314-batch Β· batch+0314
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$15.00$30.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
gpt-4-0613-batch Β· batch+0613
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$15.00$30.00Not published by the provider
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Embed Multilingual V3.0
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/Cohere-embed-v3-multilingual
β‰ˆ 111
From 29 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.10β€”512Not enough data yetNot measuredNot measured
Phi 4 Reasoning Plus
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
109.5
From 16 benchmarks. A fair amount of data behind it.
Not enough data yet$0.07$0.3532K
42.3
Poor value (42.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Text Embedding 3 Large
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
109.5
From 117 benchmarks. Plenty of data behind it.
Not enough data yet$0.13β€”8KNot enough data yetNot measuredNot measured
Text Embedding 3 Large
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
text-embedding-3-large-batch Β· batch
109.5
From 117 benchmarks. Plenty of data behind it.
Not enough data yet$0.065β€”Not published by the providerNot enough data yetNot measuredNot measured
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-0718 Β· 0718 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south +26
gpt-4o-mini-0718 Β· 0718 Β· πŸ‡¦πŸ‡ΊπŸ‡§πŸ‡·+18 australia-east, brazil-south, canada-east, us-central, us-east, us-east-2, france-central, germany-west-central, italy-north, japan-east, korea-central, us-north-central, europe-north, norway-east, poland-central, south-africa-north, us-south-central, asia-pacific-southeast, south-india, spain-central, sweden-central, switzerland-north, uae-north, united-kingdom-south, europe-west, us-west, us-west-2, us-west-3
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075batch $0.075$0.60batch $0.30Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075batch $0.075$0.60batch $0.30128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-0718 Β· regional+0718
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.165cache read $0.083$0.66Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-0718 Β· us-eu-data-zone+0718 Β· πŸ‡ΊπŸ‡ΈπŸ‡ͺπŸ‡Ί us, eu
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.165cache read $0.083$0.66Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-2024-07-18 Β· 2024-07-18
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075batch $0.075$0.60batch $0.30128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-batch Β· batch
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075$0.30Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-4o-mini-2024-07-18-batch Β· batch+2024-07-18
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075$0.30Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.71$0.71128K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Large
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
azure/mistral-large-2402 Β· 2402
108.0
From 293 benchmarks. Plenty of data behind it.
72Β Β±9
Coding IQ 72.2, 95% interval 63–81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$8.00$24.0032K
22.0
Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
120
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Large
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
azure_ai/mistral-large-latest Β· latest
108.0
From 293 benchmarks. Plenty of data behind it.
72Β Β±9
Coding IQ 72.2, 95% interval 63–81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$6.00128K
22.0
Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
120
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
WizardLM 2 8x22B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
β‰ˆ 108
From 9 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.48$0.48Not published by the provider
43.8
Poor value (43.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Mistral Small
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
azure_ai/mistral-small-2503 Β· 2503
107.8
From 316 benchmarks. Plenty of data behind it.
78Β Β±10
Coding IQ 78.4, 95% interval 68–89. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30128K
27.4
Poor value (27.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 Β±9
Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured

Run by Microsoft Azure

25 listings on this page where Microsoft Azure runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Β Cortecs AI
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”1M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Β Llmgateway
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.60Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
Β OpenRouter
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@eastus2 Β· πŸ‡ΊπŸ‡Έ eastus2
Β Requesty
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@francecentral Β· πŸ‡«πŸ‡· francecentral
Β Requesty
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.11$1.761M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4.1 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared the version names in our catalogue.
azure/gpt-4.1-mini@westus3 Β· πŸ‡ΊπŸ‡Έ westus3
Β Requesty
115.4
From 375 benchmarks. Plenty of data behind it.
91Β Β±8
Coding IQ 91.3, 95% interval 84–99. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40cache read $0.10$1.601M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
134.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Β Cortecs AI
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”400K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Β Llmgateway
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40Not published by the provider
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Β OpenRouter
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.01$0.40400K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
Β Requesty
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@eastus2 Β· πŸ‡ΊπŸ‡Έ eastus2
Β Requesty
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.005$0.40200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@francecentral Β· πŸ‡«πŸ‡· francecentral
Β Requesty
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.055cache read $0.0055$0.44200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 nano
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 5.4 NanoWe compared release dates and version names in our catalogue.
azure/gpt-5-nano@swedencentral Β· πŸ‡ΈπŸ‡ͺ swedencentral
Β Requesty
115.3
From 332 benchmarks. Plenty of data behind it.
93Β Β±13
Coding IQ 92.7, 95% interval 80–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.055cache read $0.0055$0.44200K
46.3
Poor value (46.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±9
Typical (51 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
139.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Cortecs AI
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Llmgateway
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00Not published by the provider
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β OpenRouter
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-05-13 Β· 2024-05-13
Β OpenRouter
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00$15.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4o
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/gpt-4o-2024-08-06 Β· 2024-08-06
Β OpenRouter
113.7
From 761 benchmarks. Plenty of data behind it.
77Β Β±10
Coding IQ 77.4, 95% interval 67–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $1.25$10.00128K
24.6
Poor value (24.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
128.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Β OpenRouter
111.6
From 224 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±12
Coding IQ 77.7, 95% interval 66–90. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$30.00$60.008K
37.6
Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
121.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Text Embedding 3 Large
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Llmgateway
109.5
From 117 benchmarks. Plenty of data behind it.
Not enough data yet$0.13β€”Not published by the providerNot enough data yetNot measuredNot measured
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Cortecs AI
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Llmgateway
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60Not published by the provider
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β OpenRouter
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-4o-mini@eastus2 Β· πŸ‡ΊπŸ‡Έ eastus2
Β Requesty
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-4o mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-4o-mini@swedencentral Β· πŸ‡ΈπŸ‡ͺ swedencentral
Β Requesty
108.6
From 478 benchmarks. Plenty of data behind it.
72Β Β±18
Coding IQ 71.8, 95% interval 54–90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.165cache read $0.0825$0.66128K
22.1
Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
123.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works