Evidence and sources
llminfo IQ 105.1, ranked among chat models. From 47 benchmarks. A fair amount of data behind it.How llminfo IQ is computedReleased 24 Jun 2024Maker HQ: CN (source)
Sources: GenAI Prices data, llminfo researchPrimary data from GenAI Prices
from llminfo research: release date
Advantages and trade-offs
Compared with 10 chat models, picked mainly by popularity and IQ
Trade-offs
Input & output
as stated by the model's providersText
Text
Listings
| 32K | $3.19 | $3.19 | |
| —Not published by the provider | $3.00 | $3.00 | |
| 33K | $3.00 | $3.00 |
1 listing without a price is hidden.
Benchmarks
Named effort levels run from lowest to highest. Select a result to see its source details.
Human preference
WildBench26 related benchmarks · 26 results
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
gpt4t_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.task_macro.K: -1, gpt-4-turbo-2024-04-09
Show 20 more resultsHide 20 results
haiku_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Creative Tasks.K: -1, claude-3-haiku-20240307
haiku_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Information/Advice seeking.K=-1, claude-3-haiku-20240307
haiku_reward.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.K: -1, claude-3-haiku-20240307
haiku_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Planning & Reasoning.K=-1, claude-3-haiku-20240307
haiku_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.task_macro.K: -1, claude-3-haiku-20240307
llama_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Creative Tasks.K: -1, Llama-2-70b-chat-hf
llama_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Information/Advice seeking.K=-1, Llama-2-70b-chat-hf
llama_reward.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.K: -1, Llama-2-70b-chat-hf
llama_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Planning & Reasoning.K=-1, Llama-2-70b-chat-hf
llama_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.task_macro.K: -1, Llama-2-70b-chat-hf
mixture_of_rewards.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
task_macro_reward.K=-1
Source: WildBench direct data
allenai/WildBench, task_macro_reward.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro
Coding
BigCodeBench CompleteSource: BigCodeBench Leaderboard data · May 2024
WildBench5 related benchmarks · 5 results
WB_score.Coding & Debugging
Source: WildBench direct data
allenai/WildBench, WB_score.Coding & Debugging
gpt4t_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Coding & Debugging.K=-1, claude-3-haiku-20240307
llama_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Coding & Debugging.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
Math
WildBench5 related benchmarks · 5 results
WB_score.Math & Data Analysis
Source: WildBench direct data
allenai/WildBench, WB_score.Math & Data Analysis
gpt4t_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Math & Data Analysis.K=-1, claude-3-haiku-20240307
llama_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Math & Data Analysis.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
Knowledge
MMLUSource: Epoch AI Benchmarking Hub data
Other
DubesorSource: Dubesor LLM Benchmark
Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · WildBench, Allen Institute for AI
Around the web
- 01.AI API Platform
In addition, the 01.AI API platform also provides detailed documentation and sample code to help …
In addition, the 01.AI API platform also provides detailed documentation and sample code to help developers quickly get started and utilize the capabilities of the Yi series LLMs effectively. The 01.…platform.01.ai
- 01.AI - Make AI work
National High-Tech Enterprise and Beijing SRDI SME Recognition Recognized as a National High-Tech Enterprise and …
National High-Tech Enterprise and Beijing SRDI SME Recognition Recognized as a National High-Tech Enterprise and a Beijing Specialized, Refined, Distinctive, and Innovative SME. 2025.03 WorldWise Pla…01.ai
- GitHub - 01-ai/Yi: A series of large language models trained from scratch by developers @01-ai · GitHub
08 : Yi Tech Report is published! 🔔 2024-03-07 : The long text capability of …
08 : Yi Tech Report is published! 🔔 2024-03-07 : The long text capability of the Yi-34B-200K has been enhanced. In the "Needle-in-a-Haystack" test, the Yi-34B-200K's performance is improved by 10.5%…github.com
- 01.AI's Yi Series Large Language Models
Yi LLMs Tutorials Yi LLMs Resources 01.AI Official Website Yi-34B on HuggingFace with 200K context …
Yi LLMs Tutorials Yi LLMs Resources 01.AI Official Website Yi-34B on HuggingFace with 200K context window Smaller model, Yi-6B with 200K context window on HuggingFace Application for Commercial Licen…lablab.ai
- Chinese tech unicorn 01.AI admits ‘oversight’ in changing name of AI model built on Meta Platforms’ Llama system | South China Morning Post
Beijing-based 01.AI said the company made several name changes in its open-source large language model’s …
Beijing-based 01.AI said the company made several name changes in its open-source large language model’s code as part of experimental requirements The firm has decided to change the so-called tensor …scmp.com
- 01.AI · GitHub
scratch by developers @01-ai 01-ai/Yi-1.5: Yi-1.5 is an upgraded version of Yi, delivering stronger performance …
scratch by developers @01-ai 01-ai/Yi-1.5: Yi-1.5 is an upgraded version of Yi, delivering stronger performance in coding, math, reasoning, and instruction-following capability. 01-ai/Yi-Coder: 🌟 Yi…github.com
- 01-ai/Yi-1.5-34B-32K at main
to use 01-ai/Yi-1.5-34B-32K with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-34B-32K main Yi-1.5-34B-32K 68.8 GB …
to use 01-ai/Yi-1.5-34B-32K with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-34B-32K main Yi-1.5-34B-32K 68.8 GB Ctrl+K Ctrl+K 5 contributors History: 26 commits Chen-01AI's picture Chen…huggingface.co
- 01-ai (01-ai)
picture Ming's profile picture caker555's profile picture +1 Organization Card Community About org cards Yi …
picture Ming's profile picture caker555's profile picture +1 Organization Card Community About org cards Yi Base Models Yi Chat Models Yi Multimodal Models GitHub Logo GitHub · Discord Logo Discord · …huggingface.co
- 01-ai/Yi-1.5-9B at main
Docker Model Runner How to use 01-ai/Yi-1.5-9B with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-9B …
Docker Model Runner How to use 01-ai/Yi-1.5-9B with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-9B main Yi-1.5-9B 17.7 GB Ctrl+K Ctrl+K 5 contributors History: 15 commits Chen-01AI's pic…huggingface.co
- 01-ai/Yi-1.5-9B-Chat at main
Docker Model Runner How to use 01-ai/Yi-1.5-9B-Chat with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-9B-Chat …
Docker Model Runner How to use 01-ai/Yi-1.5-9B-Chat with Docker Model Runner: docker model run hf.co/01-ai/Yi-1.5-9B-Chat main Yi-1.5-9B-Chat 17.7 GB Ctrl+K Ctrl+K 5 contributors History: 34 commits …huggingface.co
Also known as: 01-ai/yi-large, accounts/fireworks/models/yi-large, fireworks_ai/accounts/fireworks/models/yi-large, nvidia_nim/01-ai/yi-large
Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works