Skip to content

Microsoft · Chat

phi-3.5-moe-instruct

Microsoft 🇺🇸Chat
llminfo IQ
102.7
Listings
1
Providers
1

Evidence and sources

🤗 microsoft/Phi-3.5-MoE-instructllminfo IQ 102.7, ranked among chat models. From 22 benchmarks. Plenty of data behind it.How llminfo IQ is computedReleased 17 Aug 2024Maker HQ: US (source)
Sources: LiteLLM data, Hugging FacePrimary data from LiteLLM from Hugging Face: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

from the model's type
Text
Text

Listings

We don't have any priced listings for this model yet.

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Reasoning

ARC-CSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HellaSwagSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MEGASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
PIQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
QasperSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Math

MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MGSMSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Coding

HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MBPPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
RepoQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

SQuALITYSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MMLU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Factuality

Human preference

Instruction following

Long context

RULERSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Multilingual

MMMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

GovReportSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
QMSumSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Data credits: Data by LLM Stats · Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

Also known as: nvidia_nim/microsoft/phi-3.5-moe-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works