# Unsloth

> Open-source desktop app for running and training open AI models on your own hardware.

Unsloth is an open-source project behind Unsloth Desktop, a free app that runs and trains open AI models on your own Mac, Windows or Linux machine. Unsloth is used by downloading a model from its built-in hub, then chatting, fine-tuning, generating images or video, or connecting coding agents through an OpenAI-compatible API.

**Best for:** Developers and researchers who want to run, fine-tune and serve open models on their own hardware instead of a cloud service.

- Official site: https://unsloth.ai
- Listed in: [Large Language Models & Prompts](https://trendhub.net/ai-tools/category/large-language-models), [Developer API](https://trendhub.net/ai-tools/category/developer-api)
- Last checked: 2026-10-09 (facts taken from unsloth.ai)
- Source page: https://trendhub.net/ai-tools/unsloth-run-train-ai-models-locally

## Key facts

- Platforms: macOS, Windows, Linux, API
- Pricing model: Free
- Free plan: Yes
- API: Yes
- Made by: Unsloth

## What is Unsloth?

Unsloth is an open-source project whose desktop app, Unsloth Desktop, runs and trains open AI models on local hardware. The app is free and has installers for Mac (Apple Silicon and Intel), Windows 10 or later and Ubuntu-compatible Linux. A built-in model hub helps find and download a quantization suited to the device, after which you can chat with a model, fine-tune it or generate media through no-code workflows. Image models such as FLUX and Qwen-Image and video models such as Wan and LTX are supported, along with local editing operations like inpainting and upscaling. Coding agents including Claude Code and Codex can be pointed at local models with the unsloth start command, and an OpenAI-compatible API serves existing scripts and SDKs. Further functions include private web search with a Deep Research mode, sandboxed Bash and Python execution, and remote access over a Cloudflare tunnel.

## Key features

- **Local chat and model hub**: Downloads a model in a quantization that fits your machine and runs conversations on-device.
- **No-code training**: Fine-tunes open models through a desktop interface instead of scripts.
- **Image and video generation**: Creates and edits images and produces video clips locally with supported open models and LoRA adapters.
- **Agent connection**: Routes Claude Code, Codex and similar agents to a local model through one command.
- **OpenAI-compatible API**: Presents local models behind a familiar API so current apps and SDKs can call them.
- **Web search and code execution**: Adds in-app web search, a Deep Research report mode and a sandbox for running Bash and Python.

## How Unsloth works

1. **Start Unsloth and load a model**: Open the desktop app and pick a model from the hub.
2. **Open your project folder**: Go to the directory the coding agent should work in.
3. **Run the start command**: Launch the agent with unsloth start claude; models can be swapped later without changing the agent setup.

## Use cases

- **Private Chat with a Local Model**: Keep prompts and documents on your own computer.
- **Fine-Tuning an Open Model**: Train a model on your data without writing a training script.
- **Coding Agents on Your Own GPU**: Run a coding agent against a locally hosted model inside a project folder.
- **Offline Image Generation**: Produce and retouch images without a cloud service.
- **Checking a Run Remotely**: Open a tunnel and look at progress from a phone or another laptop.

## Things to know

- **Processing is local**: Models run on the user's own hardware, so capability depends on the device and the quantization chosen.
- **System requirements**: Installers are a .dmg for Mac, an .exe for Windows 10 or newer and a .deb for Ubuntu-compatible systems.
- **Remote access uses a tunnel**: Serving a local or Colab model to other devices goes through a free Cloudflare tunnel over HTTPS.

## FAQs

### What is Unsloth?

Unsloth is an open-source project that provides Unsloth Desktop, an app for running and training AI models locally.

### What is Unsloth used for?

Unsloth is used to chat with open models, fine-tune them and generate images, video and audio on a personal computer, and to connect coding agents to those local models.

### Is Unsloth free?

Yes. Unsloth describes its desktop app as free and open source.

### Which operating systems does Unsloth support?

Unsloth Desktop has downloads for Mac on Apple Silicon and Intel, Windows 10 and later, and Ubuntu-compatible Linux distributions.

### Does Unsloth have an API?

Yes. Unsloth exposes an OpenAI-compatible API so existing applications, scripts and SDKs can use local models.

### Can Unsloth work with Claude Code or Codex?

Yes. After loading a model in Unsloth, a command such as unsloth start claude connects the agent to it.

### Which models does Unsloth run?

Unsloth says it supports nearly every open model and adds new releases quickly, naming families such as Qwen, GLM and Gemma, plus FLUX for images and Wan and LTX for video.

---

Source: https://trendhub.net/ai-tools/unsloth-run-train-ai-models-locally (trendhub)
