Skip to content

Listings

All listings: Nebius AI Studio

Every listing for the models on page 3 of 4 of Nebius AI Studio, including each model's other versions and routes. Back to Nebius AI Studio

Sold by Nebius AI Studio

24 listings on this page sold by Nebius AI Studio.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/Qwen/Qwen3-30B-A3B-Instruct-2507
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
114.5
From 492 benchmarks. Plenty of data behind it.
85Β Β±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$1.50128K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 Β±9
Typical (47 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
nebius/deepseek-ai/DeepSeek-V3-0324 Β· 0324
114.5
From 492 benchmarks. Plenty of data behind it.
85Β Β±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$1.50128K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 Β±9
Typical (47 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
114.4
From 142 benchmarks. Plenty of data behind it.
90Β Β±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.3033K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 14B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
114.1
From 210 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.2433K
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.1 405B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
nebius/meta-llama/Meta-Llama-3.1-405B-Instruct
111.8
From 123 benchmarks. Plenty of data behind it.
84Β Β±9
Coding IQ 84.3, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$3.00128K
41.9
Poor value (41.9). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
BGE multilingual gemma2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
111.1
From 38 benchmarks. Plenty of data behind it.
Not enough data yet$0.01β€”8KNot enough data yetNot measuredNot measured
E5 Mistral 7B Instruct
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
110.1
From 159 benchmarks. Plenty of data behind it.
Not enough data yet$0.01β€”33KNot enough data yetNot measuredNot measured
Nemotron 3 Nano 30B A3B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B
109.7
From 137 benchmarks. Plenty of data behind it.
91Β Β±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.012$0.24262K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen2.5 32B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
109.0
From 108 benchmarks. Plenty of data behind it.
78Β Β±10stale
Coding IQ 77.8, 95% interval 67–88. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.06$0.20128KNot enough data yetNot measuredNot measured
Qwen2.5 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
108.9
From 216 benchmarks. Plenty of data behind it.
80Β Β±22
Coding IQ 79.9, 95% interval 58–102. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40128K
35.0
Poor value (35.0). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen2.5 VL 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
108.8
From 97 benchmarks. Plenty of data behind it.
Not enough data yet$0.25$0.7532K
41.2
Poor value (41.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.04$0.30110K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
BGE En Icl
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
107.4
From 13 benchmarks. A fair amount of data behind it.
Not enough data yet$0.01β€”33KNot enough data yetNot measuredNot measured
Llama 3.1 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama 3.3 70B InstructWe compared release dates and version names in our catalogue.
nebius/meta-llama/Meta-Llama-3.1-70B-Instruct
106.8
From 168 benchmarks. Plenty of data behind it.
β‰ˆ 80Β Β±11
Coding IQ 80.3, 95% interval 69–91. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40128K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3 4B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.5 4BWe compared release dates and version names in our catalogue.
105.8
From 116 benchmarks. Plenty of data behind it.
β‰ˆ 78Β Β±9
Coding IQ 78.4, 95% interval 69–88. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.2433K
32.9
Poor value (32.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Qwen2-VL (72B) Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen2.5 VL 72B InstructWe compared release dates and version names in our catalogue.
103.1
From 34 benchmarks. Plenty of data behind it.
Not enough data yet$0.13$0.40131KNot enough data yetNot measuredNot measured
Qwen2.5-Coder-7B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
99.3
From 11 benchmarks. Plenty of data behind it.
Not enough data yet$0.01$0.0333KNot enough data yetNot measured
107.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen2 VL 7b Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen2.5-VL 7B InstructWe compared release dates and version names in our catalogue.
98.3
From 30 benchmarks. Plenty of data behind it.
Not enough data yet$0.02$0.06131KNot enough data yetNot measuredNot measured
Mistral Nemo
πŸ‡«πŸ‡·
Maker headquartered in FR, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/mistralai/Mistral-Nemo-Instruct-2407
98.1
From 85 benchmarks. Plenty of data behind it.
Not enough data yet$0.04$0.12128K
52.2
Fair value (52.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
113.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek R1 Distill Llama 70B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
97.6
From 6 benchmarks. A fair amount of data behind it.
Not enough data yet$0.25$0.75128KNot enough data yetNot measuredNot measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
nebius/meta-llama/Meta-Llama-3.1-8B-Instruct
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.02$0.06128K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Llama Guard 3 8B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Not enough data yetNot enough data yet$0.02$0.06128K
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured

Run by Nebius AI Studio

24 listings on this page where Nebius AI Studio runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen3-30b-a3b-instruct-2507
Β Cortecs AI
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/Qwen/Qwen3-30B-A3B-Instruct-2507
Β Eden AI
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Qwen/Qwen3-30B-A3B-Instruct-2507
Β Hugging Face
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
qwen/qwen3-30b-a3b-instruct-2507 Β· fp8
Β OpenRouter
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nebius/qwen/qwen3-30b-a3b-instruct-2507
Β Requesty
114.9
From 100 benchmarks. Plenty of data behind it.
β‰ˆ 86Β Β±20
Coding IQ 86.4, 95% interval 67–106. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30128K
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
deepseek-ai/DeepSeek-V3-0324 Β· 0324
Β Hugging Face
114.5
From 492 benchmarks. Plenty of data behind it.
85Β Β±7
Coding IQ 85.3, 95% interval 79–92. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75$2.2533K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
47 Β±9
Typical (47 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
135.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Qwen/Qwen3-30B-A3B-Thinking-2507 Β· thinking+2507
Β Hugging Face
114.4
From 142 benchmarks. Plenty of data behind it.
90Β Β±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30262K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 30B A3B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Llmgateway
114.4
From 142 benchmarks. Plenty of data behind it.
90Β Β±10
Coding IQ 90.3, 95% interval 80–101. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
138.3
Epoch Capabilities IndexSetting: thinkingSource: Epoch AI Benchmarking Hub API
Qwen3 14B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Β Llmgateway
114.1
From 210 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.9, 95% interval 76–94. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08$0.24Not published by the provider
33.7
Poor value (33.7). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Nemotron 3 Nano 30B A3B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia-nemotron-3-nano-30b-a3b
Β Cortecs AI
109.7
From 137 benchmarks. Plenty of data behind it.
91Β Β±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”256K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3 Nano 30B A3B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 Β· bf16
Β Hugging Face
109.7
From 137 benchmarks. Plenty of data behind it.
91Β Β±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06$0.24262K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Nemotron 3 Nano 30B A3B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Β OpenRouter
109.7
From 137 benchmarks. Plenty of data behind it.
91Β Β±14
Coding IQ 91.4, 95% interval 77–106. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.06cache read $0.012$0.24262K
36.7
Poor value (36.7). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen2.5 VL 72B Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.8
From 97 benchmarks. Plenty of data behind it.
Not enough data yet$0.25$0.7532K
41.2
Poor value (41.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Cortecs AI
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”131K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30110K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30110K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
fp8
Β OpenRouter
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.04$0.30110K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 3 27B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
108.5
From 365 benchmarks. Plenty of data behind it.
73Β Β±8
Coding IQ 72.7, 95% interval 65–81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.30128K
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
127.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25$0.75131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Llmgateway
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40Not published by the provider
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 2 9B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Hugging Face
102.3
From 133 benchmarks. Plenty of data behind it.
β‰ˆ 76Β Β±10
Coding IQ 75.7, 95% interval 65–86. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.098KNot enough data yetNot measuredNot measured
Qwen2.5-Coder-7B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Β Hugging Face
99.3
From 11 benchmarks. Plenty of data behind it.
Not enough data yet$0.03$0.0933KNot enough data yetNot measured
107.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
Β Hugging Face
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.03$0.09131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Gemma 2 2B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Β Hugging Face
94.5
From 80 benchmarks. Plenty of data behind it.
Not enough data yet$0.02$0.068KNot enough data yetNot measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works