Skip to content
LocalAI

Self-hosted alternatives to LocalAI

200 self-hosted apps like LocalAI, closest match first.

Top picks

  1. O

    Ollama

    Launch

    Ollama is a tool for running open AI models on your own computer, from the terminal or through apps you build. It runs on macOS, Windows and Linux. When a model is too large for your hardware, cloud models are available too, paid for with u

  2. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

  3. T

    Textgen

    Launch

    TextGen is an open-source desktop app for running large language models locally. It has a chat and generation interface, and an OpenAI- and Anthropic-compatible API. The project's own description says it has no telemetry and works fully off

  4. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

  5. L

    Locally Uncensored

    Launch

    The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

  6. S

    Self-Hosted AI Stack

    Launch

    Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authenticatio

More like LocalAI

7
O

Open WebUI

Run AI on your own terms

Launch
8
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
9
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
10
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
11
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
12
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
13
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
14
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
15
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
16
L

LocalAGI

LocalAGI is a powerful, self-hostable AI Agent platform

Launch
17
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
18
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
19
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
20
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
21
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
22
B

Biniou

a self-hosted webui for 30+ generative ai

Launch
23
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
24
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
25
L

LLM Harbor

Containerized LLM toolkit

Launch
26
H

HeliosGen

🏆 Self Hosted Gen AI desktop app

Launch
27
L

Local-Multimodal-AI-Chat

Self-hostable multimodal chat with local LLMs

Launch
28
V

Voice Chat AI

🎙️ Speak with AI - Run locally using Ollama, OpenAI, Anthropic or xAI…

Launch
29
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
30
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
31
A

Airunner

Offline inference engine for art, real-time voice conversations

Launch
32
S

Selfhost AI

One-command installer for a self-hosted AI stack on your own server: n8n

Launch
33
W

Willow Inference Server

Open source, local, and self-hosted highly optimized language inference…

Launch
34
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
35
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
36
P

Pocketpaw

Your AI agent in 30 seconds

Launch
37
M

Mix-Studio

The cleanest, responsive AI workspace

Launch
38
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
39
J

Jan

Jan runs open-source AI models on your own hardware or connects

Launch
40
O

OpenOpenAI

Self-hosted version of OpenAI’s new stateful Assistants API

Launch
41
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
42
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
43
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
44
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
45
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
46
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
47
S

Sipp

AI inference, packed simply

Launch
48
L

Latitude

AI Agent Observability & Monitoring

Launch
49
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
50
T

TaOS

Self-hosted AI agent OS

Launch

About LocalAI

L

LocalAI

Run LLMs, speech, image generation

LocalAI is an open-source, MIT-licensed AI engine that runs language models, speech, vision, image and video generation and agents on your own hardware. Its API is compatible with OpenAI, and the site says it also speaks the Anthropic, Ollama and ElevenLabs APIs, so most tools only need a new URL. The engine behind the API can be swapped. One model can run on llama.cpp while another runs on vLLM, SGLang or MLX, and clients see the same endpoint. A small core loads each engine as a separate backend only when a model needs it. The site says LocalAI works on any hardware, including CPU-only machines, and lists support for realtime voice, speech synthesis, object detection, depth estimation and image generation. Models are available with one click from a catalog of more than 1,000. The project is on GitHub, with documentation and a blog.

Price
Open source
Category
AI
Website
localai.io