Skip to content

OpenAI · Chat

O1 Preview

OpenAI 🇺🇸ChatOpenAI family

Latest Strawberry Model

llminfo IQ
125.5
Max context
128K
Listings
15

Evidence and sources

llminfo IQ 125.5, ranked among chat models. From 80 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 86.5, 95% interval 72–102. From 4 benchmark families across 3 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (37.5). Costs more per task than its benchmark results predict. From 2 benchmarks with measured task costs. Little data behind it, so treat it as a rough estimate.How Value for money worksReleased 12 Sep 2024Maker HQ: US (according to OpenAI's own website)
Sources: LMArena data, Azure Prices API data, 302.ai data, llminfo researchPrimary data from LMArena from Azure Prices API: name from 302.ai: description from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ
We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Images
Text

Capabilities

Supported operations and provider-stated features

Reasoning

Listings

 OpenAIo1-preview-batch · batchSource: Helicone Costs dataNot published by the provider$7.50$30.00
 OpenAIo1-preview-2024-09-12-batch · batch, 2024-09-12Source: Helicone Costs dataNot published by the provider$7.50$30.00
 Microsoft Azureo1-preview-batch · batchSource: Helicone Costs dataNot published by the provider$7.50$30.00
 Microsoft Azureo1-preview-2024-09-12-batch · batch, 2024-09-12Source: Helicone Costs dataNot published by the provider$7.50$30.00
 OpenAIo1-previewSource: Helicone Costs dataNot published by the provider$15.00$60.00
 OpenAIo1-preview-2024-09-12 · 2024-09-12Source: Helicone Costs dataNot published by the provider$15.00$60.00
 Microsoft Azureo1-previewSources: Azure Prices API data, Helicone Costs dataNot published by the provider$15.00cache read $7.50$60.00
 Microsoft AzureRegions: 🇺🇸🇮🇪+1 us-east-2, europe-north, sweden-centralo1-preview-2024-09-12 · 2024-09-12Sources: Azure OpenAI, Helicone Costs dataNot published by the provider$15.00cache read $7.50$60.00
 302aio1-previewSource: 302.ai data128K$15.00$60.00
 Aihubmixo1-previewSource: AIHubMix data docsNot published by the provider$15.00cache read $7.50$60.00
Show all 13 listings

Showing 10 of 13: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

2 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Math

LiveBenchSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MGSMSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Omni-MATH12 results
Source: Omni-MATH · Sep 2024
Setting not stated
Applied Mathematics
Show 6 more resultsHide 6 results
Discrete Mathematics

Coding

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Reasoning

Agentic

Factuality

SimpleQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Instruction following

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Other

Data credits: Data by LLM Stats · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LMArena, CC BY 4.0 (licence) · ChemBench leaderboard, Jablonka group / lamalab-org. Public verified numeric result summaries; results licence not separately stated. · CyBench — cite Zhang et al. 2025 · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · JudgeBench, Sijun Tan et al., ScalerLab · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MLE-bench (OpenAI), MIT (licence)

Around the web

  • o1 Model | OpenAI API
    o1 For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available …o1 For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL. Previous full o-series reasoning model Model ID: o1 The…

    developers.openai.com

  • OpenAI o1 and new tools for developers | OpenAI
    tenth of previous audio rates. Preference Fine-Tuning ⁠ (opens in a new window) , a …tenth of previous audio rates. Preference Fine-Tuning ⁠ (opens in a new window) , a new model customization technique that makes it easier to tailor models based on user and developer preferences. Ne…

    openai.com

  • Introducing OpenAI o1 | OpenAI
    OpenAI o1-mini OpenAI o1‑mini excels at STEM, especially math and coding—nearly matching the performance of …OpenAI o1-mini OpenAI o1‑mini excels at STEM, especially math and coding—nearly matching the performance of OpenAI o1 on evaluation benchmarks such as AIME and Codeforces. We expect o1‑mini will be a…

    openai.com

  • Introducing OpenAI o1 | OpenAI
    How it works Safety Whom it’s for OpenAI o1-mini How to use OpenAI o1 What’s …How it works Safety Whom it’s for OpenAI o1-mini How to use OpenAI o1 What’s next How it works Safety Whom it’s for OpenAI o1-mini How to use OpenAI o1 What’s next Update on September 17, 2024: Rate …

    openai.com

  • o1 Preview Model | OpenAI API
    o1 Preview For the complete documentation index, see llms.txt. Markdown versions of documentation pages are …o1 Preview For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL. Preview of our first o-series reasoning model M…

    developers.openai.com

  • Economics and reasoning with OpenAI o1 - Tyler Cowen
    Skip to main content Research Products Business Developers Company Foundation (opens in a new window) …Skip to main content Research Products Business Developers Company Foundation (opens in a new window) Log in Try ChatGPT (opens in a new window) Research Products Business Developers Company Foundati…

    openai.com

  • o1-pro Model | OpenAI API
    o1-pro For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available …o1-pro For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL. Version of o1 with more compute for better response…

    developers.openai.com

  • Introducing OpenAI o1-preview | New OpenAI Announcement - #20 by VeitB - API - OpenAI Developer Community
    API announcement , chatgpt , news VeitB September 12, 2024, 8:29pm 20 You can share …API announcement , chatgpt , news VeitB September 12, 2024, 8:29pm 20 You can share your experiences and ask questions in the official announcement topic, too: New reasoning models: OpenAI o1-preview…

    community.openai.com

  • Introducing OpenAI o1-preview | New OpenAI Announcement - API - OpenAI Developer Community

    API announcement , chatgpt , news trenton.dambrowitz September 12, 2024, 5:16pm 1 https://openai.com/index/introducing-openai-o1-preview/ https://openai.com/index/openai-o1-system-card/ https://opena…

    community.openai.com

  • OpenAI releases o1, its first model with 'reasoning' abilities - The Verge
    Strawberry model. For OpenAI, o1 represents a step toward its broader goal of human-like artificial …Strawberry model. For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems…

    theverge.com

Also known as: o1-preview-2024-09-12

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works