Skip to content

Listings

All listings: DeepInfra

Every listing for the models on page 6 of 11 of DeepInfra, including each model's other versions and routes. Back to DeepInfra

Sold by DeepInfra

23 listings on this page sold by DeepInfra.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueEpoch Capabilities Index
Llama 3.3 70B Instruct Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
β‰ˆ 109
From 79 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.10$0.32131K
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$0.4033K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.16131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.40131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
WizardLM 2 8x22B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
β‰ˆ 108
From 9 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.48$0.4866K
43.8
Poor value (43.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Multilingual E5 Large Instruct
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
107.8
From 185 benchmarks. Plenty of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.15131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
BGE En Icl
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
107.4
From 13 benchmarks. A fair amount of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
DeepSeek R1 Distill Qwen 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
107.1
From 40 benchmarks. Plenty of data behind it.
β‰ˆ 81Β Β±12stale
Coding IQ 80.5, 95% interval 68–93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.27$0.27131KNot enough data yetNot measured
Llama 3.1 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama 3.3 70B InstructWe compared release dates and version names in our catalogue.
deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct
106.8
From 168 benchmarks. Plenty of data behind it.
β‰ˆ 80Β Β±11
Coding IQ 80.3, 95% interval 69–91. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$0.40131K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/Llama-4-Scout-17B-16E-Instruct
106.3
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30328K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Small 24B Instruct
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/Mistral-Small-24B-Instruct-2501 Β· 2501 Β· fp8
106.3
From 74 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.9, 95% interval 67–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.0833KNot enough data yetNot measured
Phi 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
105.9
From 144 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.6, 95% interval 66–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.1416K
51.2
Fair value (51.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
129.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Veo 3.1 Fast
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
β‰ˆ 102
From 10 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
Hermes 3 Llama 3.1 70B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
102.1
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.70$0.70131KNot enough data yetNot measured
BGE M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
100.9
From 136 benchmarks. Plenty of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
FLUX.2 [max]
πŸ‡©πŸ‡ͺ
Maker headquartered in DE, according to the company's own website. The citation is on the model page.
100.5
From 170 benchmarks. A fair amount of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
FLUX.2 [pro]
πŸ‡©πŸ‡ͺ
Maker headquartered in DE, according to the company's own website. The citation is on the model page.
99.9
From 155 benchmarks. A fair amount of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
Multilingual E5 Large
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
99.5
From 122 benchmarks. Plenty of data behind it.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measured
Qwen2.5 7B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
98.8
From 248 benchmarks. Plenty of data behind it.
73Β Β±9stale
Coding IQ 73.2, 95% interval 64–82. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.04$0.1033K
54.3
Good value (54.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Mistral Nemo
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/Mistral-Nemo-Instruct-2407
98.1
From 85 benchmarks. Plenty of data behind it.
Not enough data yet$0.029$0.03131K
52.2
Fair value (52.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
113.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek R1 Distill Llama 70B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
97.6
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.20$0.60131KNot enough data yetNot measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct Β· fp8
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.05131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured

Run by DeepInfra

47 listings on this page where DeepInfra runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueEpoch Capabilities Index
Llama 3.3 70B Instruct Turbo
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
β‰ˆ 109
From 79 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.12$0.30131K
32.5
Poor value (32.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Β Hugging Face
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$0.4033K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8 Β· πŸ‡ΊπŸ‡Έ US
Β NanoGPT
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.378$0.42Not published by the provider
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8
Β OpenRouter
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.36$0.4033K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
fp8/flex Β· fp8
Β OpenRouter
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.288$0.3233K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Β Requesty
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.40131K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.16131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.16131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Β OpenRouter
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.16131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex Β· fp8
Β OpenRouter
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.064$0.128131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/priority Β· fp8
Β OpenRouter
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.12$0.24131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.32131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.32131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8 Β· πŸ‡ΊπŸ‡Έ US
Β NanoGPT
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.105$0.336Not published by the provider
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
turbo Β· fp8
Β OpenRouter
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.32131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.40131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
WizardLM 2 8x22B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
β‰ˆ 108
From 9 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.48$0.4866K
43.8
Poor value (43.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
Β Eden AI
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.15131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
Β Hugging Face
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.15131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
bf16
Β OpenRouter
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.15131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
bf16/flex Β· bf16
Β OpenRouter
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04$0.12131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Gemma 3 12B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGemma 4 12B ItWe compared release dates and version names in our catalogue.
bf16/priority Β· bf16
Β OpenRouter
107.6
From 331 benchmarks. Plenty of data behind it.
68Β Β±19
Coding IQ 68.1, 95% interval 49–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075$0.225131K
41.7
Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Llama 3.1 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama 3.3 70B InstructWe compared release dates and version names in our catalogue.
deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct
Β Requesty
106.8
From 168 benchmarks. Plenty of data behind it.
β‰ˆ 80Β Β±11
Coding IQ 80.3, 95% interval 69–91. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.23$0.40131K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/Llama-4-Scout-17B-16E-Instruct
Β Hugging Face
106.3
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30328K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Β OpenRouter
106.3
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30328K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex Β· fp8
Β OpenRouter
106.3
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.24328K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/priority Β· fp8
Β OpenRouter
106.3
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.45328K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Small 24B Instruct
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepinfra/mistralai/Mistral-Small-24B-Instruct-2501 Β· 2501
Β Eden AI
106.3
From 74 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.9, 95% interval 67–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.0833KNot enough data yetNot measured
Mistral Small 24B Instruct
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/mistral-small-24b-instruct-2501 Β· 2501 Β· fp8 Β· πŸ‡ΊπŸ‡Έ US
Β NanoGPT
106.3
From 74 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.9, 95% interval 67–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0525$0.084Not published by the providerNot enough data yetNot measured
Mistral Small 24B Instruct
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/mistral-small-24b-instruct-2501 Β· fp8/flex+2501 Β· fp8
Β OpenRouter
106.3
From 74 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.9, 95% interval 67–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.04$0.06433KNot enough data yetNot measured
Mistral Small 24B Instruct
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
mistralai/mistral-small-24b-instruct-2501 Β· fp8+2501 Β· fp8
Β OpenRouter
106.3
From 74 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.9, 95% interval 67–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.0833KNot enough data yetNot measured
Qwen 2.5 Coder 32B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
106.3
From 104 benchmarks. Plenty of data behind it.
81Β Β±9
Coding IQ 80.7, 95% interval 72–89. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.1616K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Llama 3.2 90B Vision Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
106.1
From 54 benchmarks. Plenty of data behind it.
Not enough data yet$0.35$0.40131K
57.0
Good value (57.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Phi 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
105.9
From 144 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.6, 95% interval 66–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.1416K
51.2
Fair value (51.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
129.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Phi 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16
Β OpenRouter
105.9
From 144 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.6, 95% interval 66–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.144K
51.2
Fair value (51.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
129.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Phi 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
bf16/flex Β· bf16
Β OpenRouter
105.9
From 144 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.6, 95% interval 66–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.056$0.11216K
51.2
Fair value (51.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
129.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Phi 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
105.9
From 144 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±11
Coding IQ 77.6, 95% interval 66–89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.1416K
51.2
Fair value (51.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
129.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Hermes 3 Llama 3.1 70B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
102.1
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.70$0.70131KNot enough data yetNot measured
Hermes 3 Llama 3.1 70B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
102.1
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.70$0.70131KNot enough data yetNot measured
BGE M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Llmgateway
100.9
From 136 benchmarks. Plenty of data behind it.
Not enough data yet$0.01β€”Not published by the providerNot enough data yetNot measured
Qwen2.5 7B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
98.8
From 248 benchmarks. Plenty of data behind it.
73Β Β±9stale
Coding IQ 73.2, 95% interval 64–82. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.04$0.1033K
54.3
Good value (54.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
Mistral Nemo
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Β OpenRouter
98.1
From 85 benchmarks. Plenty of data behind it.
Not enough data yet$0.029$0.03131K
52.2
Fair value (52.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
113.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Mistral Nemo
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8/flex Β· fp8
Β OpenRouter
98.1
From 85 benchmarks. Plenty of data behind it.
Not enough data yet$0.0232$0.024131K
52.2
Fair value (52.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
113.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek R1 Distill Llama 70B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Β Requesty
97.6
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.23$0.6964KNot enough data yetNot measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
Β Hugging Face
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.02$0.04131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
fp8 Β· πŸ‡ΊπŸ‡Έ US
Β NanoGPT
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.021$0.042Not published by the provider
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
fp8
Β OpenRouter
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.02$0.04131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works