Unsloth
Open-source desktop app for running and training open AI models on your own hardware.
Unsloth is an open-source project behind Unsloth Desktop, a free app that runs and trains open AI models on your own Mac, Windows or Linux machine. Unsloth is used by downloading a model from its built-in hub, then chatting, fine-tuning, generating images or video, or connecting coding agents through an OpenAI-compatible API.
Best for Developers and researchers who want to run, fine-tune and serve open models on their own hardware instead of a cloud service.
- Platforms
- macOS, Windows, Linux, API
- Pricing model
- Free
- Free plan
- Yes
- API
- Yes
- Made by
- Unsloth
- Added
Last verified: . Information taken from unsloth.ai.
What is Unsloth?
Unsloth is an open-source project whose desktop app, Unsloth Desktop, runs and trains open AI models on local hardware. The app is free and has installers for Mac (Apple Silicon and Intel), Windows 10 or later and Ubuntu-compatible Linux. A built-in model hub helps find and download a quantization suited to the device, after which you can chat with a model, fine-tune it or generate media through no-code workflows. Image models such as FLUX and Qwen-Image and video models such as Wan and LTX are supported, along with local editing operations like inpainting and upscaling. Coding agents including Claude Code and Codex can be pointed at local models with the unsloth start command, and an OpenAI-compatible API serves existing scripts and SDKs. Further functions include private web search with a Deep Research mode, sandboxed Bash and Python execution, and remote access over a Cloudflare tunnel.
Key Features
Local chat and model hub
Downloads a model in a quantization that fits your machine and runs conversations on-device.
No-code training
Fine-tunes open models through a desktop interface instead of scripts.
Image and video generation
Creates and edits images and produces video clips locally with supported open models and LoRA adapters.
Agent connection
Routes Claude Code, Codex and similar agents to a local model through one command.
OpenAI-compatible API
Presents local models behind a familiar API so current apps and SDKs can call them.
Web search and code execution
Adds in-app web search, a Deep Research report mode and a sandbox for running Bash and Python.
How Unsloth works
Start Unsloth and load a model
Open the desktop app and pick a model from the hub.
Open your project folder
Go to the directory the coding agent should work in.
Run the start command
Launch the agent with unsloth start claude; models can be swapped later without changing the agent setup.
Screenshots
Use Cases
- Private Chat with a Local Model
- Keep prompts and documents on your own computer.
- Fine-Tuning an Open Model
- Train a model on your data without writing a training script.
- Coding Agents on Your Own GPU
- Run a coding agent against a locally hosted model inside a project folder.
- Offline Image Generation
- Produce and retouch images without a cloud service.
- Checking a Run Remotely
- Open a tunnel and look at progress from a phone or another laptop.
Things to know
- Processing is local
- Models run on the user's own hardware, so capability depends on the device and the quantization chosen.
- System requirements
- Installers are a .dmg for Mac, an .exe for Windows 10 or newer and a .deb for Ubuntu-compatible systems.
- Remote access uses a tunnel
- Serving a local or Colab model to other devices goes through a free Cloudflare tunnel over HTTPS.
FAQs
What is Unsloth?
Unsloth is an open-source project that provides Unsloth Desktop, an app for running and training AI models locally.
What is Unsloth used for?
Unsloth is used to chat with open models, fine-tune them and generate images, video and audio on a personal computer, and to connect coding agents to those local models.
Is Unsloth free?
Yes. Unsloth describes its desktop app as free and open source.
Which operating systems does Unsloth support?
Unsloth Desktop has downloads for Mac on Apple Silicon and Intel, Windows 10 and later, and Ubuntu-compatible Linux distributions.
Does Unsloth have an API?
Yes. Unsloth exposes an OpenAI-compatible API so existing applications, scripts and SDKs can use local models.
Can Unsloth work with Claude Code or Codex?
Yes. After loading a model in Unsloth, a command such as unsloth start claude connects the agent to it.
Which models does Unsloth run?
Unsloth says it supports nearly every open model and adds new releases quickly, naming families such as Qwen, GLM and Gemma, plus FLUX for images and Wan and LTX for video.
Who it's for
- Developers
- ML engineers
- Researchers
- AI hobbyists
- Privacy-focused users
Used in these workflows
- Building an AI-powered app: the tool stack, layer by layerStage 1: Choosing a model
Each guide lists the stages of one job and the tools that help at each stage. All guides
Comments
No comments yet. If you have used Unsloth, tell other readers how it went.
Alternatives to Unsloth
| Tool | Free plan | Starting price | API |
|---|---|---|---|
 TinfoilPrivate AI cloud that runs models inside secure hardware enclaves, offered as a chat app, an inference API and containers. |
— | — | Yes |
 APIParkUnified gateway for calling, authenticating, billing and monitoring AI models, APIs and MCP services. |
— | — | Yes |
 DeepSeekAI research company offering a chat assistant, a desktop harness and a token-billed API for its language models. |
— | — | Yes |
 AirbyteOpen-source data movement platform that replicates data from 700+ sources and exposes it to analytics and AI agents. |
— | — | Yes |
 CVATData annotation platform for labelling images, video, 3D point clouds and audio, offered as cloud, self-hosted and open source. |
Yes | — | Yes |
Listed in the same categories as Unsloth. A starting price appears only where we checked it on the maker’s pricing page; a dash means not checked or not published. All Large Language Models & Prompts tools