Listings
All listings: Eden AI
Every listing for the models on page 7 of 9 of Eden AI, including each model's other versions and routes. Back to Eden AI
Sold by Eden AI
49 listings on this page sold by Eden AI.
Select a score for details.
About these columns
- llminfo IQ
- llminfo IQ (capability index). How llminfo IQ is computed
- Coding IQ
- llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
- Value
- Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
- Yap
- Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
- Epoch Capabilities Index
- Epoch Capabilities Index benchmark details
| Model | llminfo IQ | Coding IQ | Input $/1M | Output $/1M | Max Input Tokens | Value | Yap | Epoch Capabilities Index |
|---|---|---|---|---|---|---|---|---|
Gemini 3.1 Flash-Lite Image Inference by GoogleπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | β 109From 14 benchmarks. Little data behind it, so treat it as a rough estimate. | βNot enough data yet | $0.25 | $1.50 | 66K | 37.6Poor value (37.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
GPT-4o mini Inference by OpenAIπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 108.6From 478 benchmarks. Plenty of data behind it. | 72Β Β±18Coding IQ 71.8, 95% interval 54β90. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.075 | $0.60 | 128K | 22.1Poor value (22.1). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 123.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 3 27B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.5From 365 benchmarks. Plenty of data behind it. | 73Β Β±8Coding IQ 72.7, 95% interval 65β81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.23 | $0.38 | 128K | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 127.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 3 27B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.5From 365 benchmarks. Plenty of data behind it. | 73Β Β±8Coding IQ 72.7, 95% interval 65β81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.23 | $0.38 | 128K | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 127.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 3 27B IT Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.5From 365 benchmarks. Plenty of data behind it. | 73Β Β±8Coding IQ 72.7, 95% interval 65β81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.08 | $0.16 | 131K | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 127.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 3 27B IT Inference by Nebius AI StudioπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.5From 365 benchmarks. Plenty of data behind it. | 73Β Β±8Coding IQ 72.7, 95% interval 65β81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.10 | $0.30 | 110K | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 127.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemma 3 27B IT Inference by ScalewayπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.5From 365 benchmarks. Plenty of data behind it. | 73Β Β±8Coding IQ 72.7, 95% interval 65β81. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.2871 | $0.5743 | 40K | 46.2Poor value (46.2). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 127.6Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Llama 3.3 70B Instruct Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.1From 278 benchmarks. Plenty of data behind it. | 77Β Β±9Coding IQ 77.1, 95% interval 68β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.10 | $0.32 | 131K | 31.6Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 126.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Llama 3.3 70B Instruct Inference by IonosπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.1From 278 benchmarks. Plenty of data behind it. | 77Β Β±9Coding IQ 77.1, 95% interval 68β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.7144 | $0.7144 | 128K | 31.6Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 126.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Llama 3.3 70B Instruct Inference by ScalewayπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 108.1From 278 benchmarks. Plenty of data behind it. | 77Β Β±9Coding IQ 77.1, 95% interval 68β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.9891 | $0.9891 | 128K | 31.6Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | 126.2Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Mistral Large Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. | 108.0From 293 benchmarks. Plenty of data behind it. | 72Β Β±9Coding IQ 72.2, 95% interval 63β81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $2.00cache read $0.20 | $6.00 | 131K | 22.0Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 120Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Mistral Large Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. | 108.0From 293 benchmarks. Plenty of data behind it. | 72Β Β±9Coding IQ 72.2, 95% interval 63β81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $2.20cache read $0.22 | $6.60 | 131K | 22.0Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 120Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Mistral Large Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. | 108.0From 293 benchmarks. Plenty of data behind it. | 72Β Β±9Coding IQ 72.2, 95% interval 63β81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $2.20cache read $0.22 | $6.60 | 1M | 22.0Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 120Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Mistral Large Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. | 108.0From 293 benchmarks. Plenty of data behind it. | 72Β Β±9Coding IQ 72.2, 95% interval 63β81. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $2.00cache read $0.20 | $6.00 | 1M | 22.0Poor value (22.0). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 120Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
WizardLM 2 8x22B Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | β 108From 9 benchmarks. Little data behind it, so treat it as a rough estimate. | βNot enough data yet | $0.48 | $0.48 | 66K | 43.8Poor value (43.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Mistral Small Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.8From 316 benchmarks. Plenty of data behind it. | 78Β Β±10Coding IQ 78.4, 95% interval 68β89. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.015 | $0.60 | 262K | 27.4Poor value (27.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 Β±9Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Mistral Small Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.8From 316 benchmarks. Plenty of data behind it. | 78Β Β±10Coding IQ 78.4, 95% interval 68β89. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.165cache read $0.0165 | $0.66 | 262K | 27.4Poor value (27.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 Β±9Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Mistral Small Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.8From 316 benchmarks. Plenty of data behind it. | 78Β Β±10Coding IQ 78.4, 95% interval 68β89. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.165cache read $0.0165 | $0.66 | 262K | 27.4Poor value (27.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 Β±9Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Mistral Small Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.8From 316 benchmarks. Plenty of data behind it. | 78Β Β±10Coding IQ 78.4, 95% interval 68β89. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.15cache read $0.015 | $0.60 | 262K | 27.4Poor value (27.4). Costs more per task than its benchmark results predict. Plenty of data behind it. | 59 Β±9Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Gemma 3 12B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 107.6From 331 benchmarks. Plenty of data behind it. | 68Β Β±19Coding IQ 68.1, 95% interval 49β87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.09 | $0.29 | 128K | 41.7Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | βNot measured |
Gemma 3 12B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 107.6From 331 benchmarks. Plenty of data behind it. | 68Β Β±19Coding IQ 68.1, 95% interval 49β87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.09 | $0.29 | 128K | 41.7Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | βNot measured |
Gemma 3 12B IT Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. Newer version | 107.6From 331 benchmarks. Plenty of data behind it. | 68Β Β±19Coding IQ 68.1, 95% interval 49β87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.05 | $0.15 | 131K | 41.7Poor value (41.7). Costs more per task than its benchmark results predict. A fair amount of data behind it. | βNot measured | βNot measured |
Ministral 8B Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.6From 73 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.15cache read $0.015 | $0.15 | 262K | 54.6Good value (54.6). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Ministral 8B Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 107.6From 73 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.165cache read $0.0165 | $0.165 | 262K | 54.6Good value (54.6). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Nova Pro Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 106.4From 119 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.80cache read $0.2175 | $3.20 | 300K | 36.8Poor value (36.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Nova Pro Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 106.4From 119 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.80cache read $0.2175 | $3.20 | 300K | 36.8Poor value (36.8). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Mistral Small 24B Instruct Inference by DeepInfraπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 106.3From 74 benchmarks. Plenty of data behind it. | β 78Β Β±11Coding IQ 77.9, 95% interval 67β89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.05 | $0.08 | 33K | βNot enough data yet | βNot measured | βNot measured |
Qwen 2.5 Coder 32B Instruct Inference by Cloudflare Workers AIπ¨π³Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 106.3From 104 benchmarks. Plenty of data behind it. | 81Β Β±9Coding IQ 80.7, 95% interval 72β89. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.66 | $1.00 | 33K | 50.7Fair value (50.7). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
GPT-4.1 nano Inference by Microsoft AzureπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 105.3From 325 benchmarks. Plenty of data behind it. | 75Β Β±9Coding IQ 74.7, 95% interval 66β83. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.10cache read $0.025 | $0.40 | 1M | 27.8Poor value (27.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 126.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-4.1 nano Inference by Microsoft AzureπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 105.3From 325 benchmarks. Plenty of data behind it. | 75Β Β±9Coding IQ 74.7, 95% interval 66β83. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.11cache read $0.0275 | $0.44 | 1M | 27.8Poor value (27.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 126.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
GPT-4.1 nano Inference by Microsoft AzureπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 105.3From 325 benchmarks. Plenty of data behind it. | 75Β Β±9Coding IQ 74.7, 95% interval 66β83. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.11cache read $0.0275 | $0.44 | 1M | 27.8Poor value (27.8). Costs more per task than its benchmark results predict. Plenty of data behind it. | βNot measured | 126.8Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API |
Gemini 2.5 Flash Image Inference by GoogleπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Newer version | 105.2From 184 benchmarks. A fair amount of data behind it. | βNot enough data yet | $0.30cache read $0.03 | $2.50 | 33K | 60.9Good value (60.9). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Nova Lite Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 104.8From 107 benchmarks. Plenty of data behind it. | β 82Β Β±10Coding IQ 82.3, 95% interval 72β93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.06cache read $0.0163 | $0.24 | 300K | 41.5Poor value (41.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | 38 Β±9Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Nova Lite Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 104.8From 107 benchmarks. Plenty of data behind it. | β 82Β Β±10Coding IQ 82.3, 95% interval 72β93. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.06cache read $0.0163 | $0.24 | 300K | 41.5Poor value (41.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | 38 Β±9Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate. | βNot measured |
Nova Micro Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 103.3From 102 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.035cache read $0.011 | $0.14 | 128K | 47.4Poor value (47.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Nova Micro Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. | 103.3From 102 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.035cache read $0.011 | $0.14 | 128K | 47.4Poor value (47.4). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Hermes 3 Llama 3.1 70B Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 102.1From 6 benchmarks. A fair amount of data behind it. | βNot enough data yet | $0.70 | $0.70 | 131K | βNot enough data yet | βNot measured | βNot measured |
Ministral 3B Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 100.6From 24 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.10cache read $0.01 | $0.10 | 131K | 38.6Poor value (38.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Ministral 3B Inference by Mistral AIπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 100.6From 24 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.11cache read $0.011 | $0.11 | 131K | 38.6Poor value (38.6). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Qwen2.5 7B Instruct Inference by DeepInfraπ¨π³Maker headquartered in CN, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 98.8From 248 benchmarks. Plenty of data behind it. | 73Β Β±9staleCoding IQ 73.2, 95% interval 64β82. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old. | $0.04 | $0.10 | 33K | 54.3Good value (54.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Gemma 3 4B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 95.2From 249 benchmarks. Plenty of data behind it. | 67Β Β±19Coding IQ 66.8, 95% interval 48β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.04 | $0.08 | 128K | 38.3Poor value (38.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Gemma 3 4B IT Inference by Amazon Web ServicesπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 95.2From 249 benchmarks. Plenty of data behind it. | 67Β Β±19Coding IQ 66.8, 95% interval 48β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.04 | $0.08 | 128K | 38.3Poor value (38.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Gemma 3 4B IT Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 95.2From 249 benchmarks. Plenty of data behind it. | 67Β Β±19Coding IQ 66.8, 95% interval 48β86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.05 | $0.10 | 131K | 38.3Poor value (38.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Llama 3.2 11B Vision Instruct Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 92.2From 59 benchmarks. Plenty of data behind it. | βNot enough data yet | $0.345 | $0.345 | 131K | 56.1Good value (56.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Mixtral 8x7B Instruct v0.1 Inference by DeepInfraπ«π·Maker headquartered in FR, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 92.0From 202 benchmarks. Plenty of data behind it. | β 76Β Β±12Coding IQ 75.7, 95% interval 64β88. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.40 | $0.40 | 33K | βNot enough data yet | βNot measured | βNot measured |
Llama 3.2 3B Inference by Cloudflare Workers AIπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 86.5From 255 benchmarks. Plenty of data behind it. | β 76Β Β±14Coding IQ 75.7, 95% interval 62β89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.0509 | $0.335 | 80K | 44.3Poor value (44.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Llama 3.2 3B Inference by DeepInfraπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | 86.5From 255 benchmarks. Plenty of data behind it. | β 76Β Β±14Coding IQ 75.7, 95% interval 62β89. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. | $0.02 | $0.02 | 131K | 44.3Poor value (44.3). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Llama Prompt Guard 2 22M Inference by GroqπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | βNot enough data yet | βNot enough data yet | $0.03cache read $0.015 | $0.03 | 512 | βNot enough data yet | βNot measured | βNot measured |
Command R7b 12 2024 Inference by CohereπΊπΈMaker headquartered in US, according to the company's own website. The citation is on the model page. Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo. | βNot enough data yet | βNot enough data yet | $0.0375 | $0.15 | 132K | 47.5Fair value (47.5). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate. | βNot measured | βNot measured |
Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)