Skip to content

Unsloth · Chat

Gemma 3 4B IT

UnslothChatGemini familyOpen weights. One of its sources says the weights are publicly available.
Market median price
$0.1896 blended / 1M
Max context
128K
Listings
2
Providers
1

Evidence and sources

🤗 unsloth/gemma-3-4b-itReleased 12 Mar 2025
All rankings: #185 on NanoGPT recentlySources: Models.dev data, Hugging FacePrimary data from Models.dev from Hugging Face: release date

Advantages and trade-offs

Compared with 10 representative chat models

Advantages

Open weights available

The weights are public. 4 of the 10 peers that say either way have open weights.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Prompt caching

Listings

 NanoGPTInference by KitaniRegions: GLBunsloth/gemma-3-4b-it · int4Source: NanoGPTNot published by the provider$0.1896cache read $0.0948$0.1896
 NanoGPTunsloth/gemma-3-4b-itSources: Models.dev data, NanoGPT128K$0.2006cache read $0.1003$0.2006

Benchmarks

No benchmark scores yet.

Around the web

  • Gemma 3 - How to Run Guide | Unsloth Documentation
    Unsloth is the only framework which works in float16 machines for Gemma 3 inference and …Unsloth is the only framework which works in float16 machines for Gemma 3 inference and training. This means Colab Notebooks with free Tesla T4 GPUs also work! Fine-tune Gemma 3 (4B) with vision supp…

    unsloth.ai

    Docs
  • Gemma 4 - How to Run Locally | Unsloth Documentation
    ``` curl -fsSL · sh curl -fsSL · sh source ~/.unsloth/unsloth_gemma4_mlx/bin/activate source ~/.unsloth/unsloth_gemma4_mlx/bin/activate python -m …``` curl -fsSL · sh curl -fsSL · sh source ~/.unsloth/unsloth_gemma4_mlx/bin/activate source ~/.unsloth/unsloth_gemma4_mlx/bin/activate python -m mlx_vlm.chat --model unsloth/gemma-4-26b-a4b-it-UD-ML…

    unsloth.ai

    Docs
  • unsloth/gemma-4-26B-A4B-it-GGUF · Hugging Face
    Hugging Face · GitHub · Launch Blog · Documentation License: Apache 2.0 · Authors: Google …Hugging Face · GitHub · Launch Blog · Documentation License: Apache 2.0 · Authors: Google DeepMind Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling t…

    huggingface.co

    Model card
  • Google - Gemma 4 now in Unsloth! · unslothai/unsloth · Discussion #4800 · GitHub
    Google releases Gemma 4 with four new models: E2B, E4B, 26B-A4B, 31B. You can now …Google releases Gemma 4 with four new models: E2B, E4B, 26B-A4B, 31B. You can now run and train the Gemma 4 models in Unsloth. Guide / Blog: The multimodal reasoning models are licensed under Apach…

    github.com

    Repository
  • GitHub - unslothai/unsloth: Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. · GitHub
    ## ⭐ Features Unsloth works on Windows, Linux, WSL and macOS. We support Multi GPU …## ⭐ Features Unsloth works on Windows, Linux, WSL and macOS. We support Multi GPU setups, NVIDIA, AMD, Intel GPUs, CPUs and the Vulkan backend. ### Run & Build with AI [...] · Model · Free Notebooks…

    github.com

    Repository
  • Gemma 4 - a unsloth Collection

    #### unsloth/gemma-4-E2B-it-UD-MLX-4bit #### unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit #### unsloth/gemma-4-31b-it-UD-MLX-3bit #### unsloth/gemma-4-31B-it-unsloth-bnb-4bit Note Dynamic 4-bit Bitsandbyte…

    huggingface.co

    Model card
  • Gemma 3 - a unsloth Collection

    #### unsloth/gemma-3-270m-it-bnb-4bit #### unsloth/gemma-3-1b-it-bnb-4bit #### unsloth/gemma-3-4b-it-bnb-4bit #### unsloth/gemma-3-12b-it-bnb-4bit #### unsloth/gemma-3-12b-pt-unsloth-bnb-4bit Note Un…

    huggingface.co

    Model card
  • Gemma 4 is seriously broken when using Unsloth and llama.cpp : r/LocalLLaMA
    Skip to main contentGemma 4 is seriously broken when using Unsloth and llama.cpp : r/LocalLLaMA …Skip to main contentGemma 4 is seriously broken when using Unsloth and llama.cpp : r/LocalLLaMA Open menu Open navigation, and then in EACH message character refers to user as "dumbass" strictly once…

    reddit.com

    Discussion
  • Fine-tune & Run Gemma 3n with Unsloth
    Unsloth is the only framework which works in float16 machines for Gemma 3n inference and …Unsloth is the only framework which works in float16 machines for Gemma 3n inference and training. This means Colab Notebooks with free Tesla T4 GPUs also work!Gemma 3n-E4B finetuning fits with Unslo…

    unsloth.ai

  • Fine-tune Gemma 3 with Unsloth
    This means Unsloth is the only framework which works in float16 machines for Gemma 3! …This means Unsloth is the only framework which works in float16 machines for Gemma 3! This also means Colab Notebooks with free Tesla T4 GPUs also work! Gemma 3 (27B) finetuning fits with Unsloth in …

    unsloth.ai

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works