Skip to content
LocalAI

Open source alternatives to LocalAI

200 open source apps like LocalAI, closest match first.

Top picks

  1. O

    Ollama

    Launch

    Ollama is a tool for running open AI models on your own computer, from the terminal or through apps you build. It runs on macOS, Windows and Linux. When a model is too large for your hardware, cloud models are available too, paid for with u

  2. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

  3. T

    Textgen

    Launch

    TextGen is an open-source desktop app for running large language models locally. It has a chat and generation interface, and an OpenAI- and Anthropic-compatible API. The project's own description says it has no telemetry and works fully off

  4. H

    HilbertRaum

    Launch

    HilbertRaum is local AI software for working with sensitive documents without uploading them to a cloud service. The software runs on your own computer, so documents, questions and answers never leave the device, and it works offline. You c

  5. O

    ollama

    Launch

    Ollama – Local AI Model Runner Run, manage, and switch between a wide range of open‑source LLMs directly on your local machine. Ollama provides fast, offline inference with a simple CLI and API, ensuring your data never leaves the device. I

  6. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

More like LocalAI

7
W

whatcani.run

Find the best models and how to run them locally

Launch
8
L

Locally Uncensored

The all-in-one local AI studio for your desktop: chat

Launch
9
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
10
O

Open WebUI

Run AI on your own terms

Launch
11
C

ChatLLM-Web

Private local model studio, AI chat

Launch
12
L

LLM X

LLMX; Easiest 3rd party Local LLM UI for the web!

Launch
13
L

Llamastash

Zero-overhead, terminal-native local-LLM runtime manager

Launch
14
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
15
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
16
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
17
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
18
R

Reins

Local AI chat for iPhone, iPad and Mac

Launch
19
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
20
O

OpenLive

Opensource, on-device voice + vision layer for AI agents

Launch
21
L

Local Studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

Launch
22
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
23
O

OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server

Launch
24
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
25
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
26
L

llama.cpp

C/C++ inference engine for large language models, supporting quantization

Launch
27
G

Gerbil

A desktop app for running Large Language Models locally

Launch
28
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
29
W

Web LLM

High-performance In-browser LLM Inference Engine

Launch
30
P

Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS

Launch
31
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
32
V

vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server

Launch
33
F

Fox

A local LLM server built for concurrent work

Launch
34
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
35
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
36
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
37
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
38
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
39
B

Biniou

a self-hosted webui for 30+ generative ai

Launch
40
M

Manifest

A complete backend in a single YAML file

Launch
41
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
42
L

LLM Harbor

Containerized LLM toolkit

Launch
43
H

HeliosGen

🏆 Self Hosted Gen AI desktop app

Launch
44
L

Local-Multimodal-AI-Chat

Self-hostable multimodal chat with local LLMs

Launch
45
L

Local Llms On Android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private

Launch
46
V

Voice Chat AI

🎙️ Speak with AI - Run locally using Ollama, OpenAI, Anthropic or xAI…

Launch
47
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
48
L

LiteLLM

Acts as a unified proxy across 100+ LLMs

Launch
49
S

Speech To Speech

Build voice agents with open-source models

Launch
50
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch

About LocalAI

L

LocalAI

Run LLMs, speech, image generation

LocalAI is an open-source, MIT-licensed AI engine that runs language models, speech, vision, image and video generation and agents on your own hardware. Its API is compatible with OpenAI, and the site says it also speaks the Anthropic, Ollama and ElevenLabs APIs, so most tools only need a new URL. The engine behind the API can be swapped. One model can run on llama.cpp while another runs on vLLM, SGLang or MLX, and clients see the same endpoint. A small core loads each engine as a separate backend only when a model needs it. The site says LocalAI works on any hardware, including CPU-only machines, and lists support for realtime voice, speech synthesis, object detection, depth estimation and image generation. Models are available with one click from a catalog of more than 1,000. The project is on GitHub, with documentation and a blog.

Price
Open source
Category
AI
Website
localai.io