Skip to content
LocalAI

Alternatives to LocalAI

200 apps like LocalAI, closest match first.

Top picks

  1. O

    Ollama

    Launch

    Ollama is a tool for running open AI models on your own computer, from the terminal or through apps you build. It runs on macOS, Windows and Linux. When a model is too large for your hardware, cloud models are available too, paid for with u

  2. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

  3. T

    Textgen

    Launch

    TextGen is an open-source desktop app for running large language models locally. It has a chat and generation interface, and an OpenAI- and Anthropic-compatible API. The project's own description says it has no telemetry and works fully off

  4. H

    HilbertRaum

    Launch

    HilbertRaum is local AI software for working with sensitive documents without uploading them to a cloud service. The software runs on your own computer, so documents, questions and answers never leave the device, and it works offline. You c

  5. O

    ollama

    Launch

    Ollama – Local AI Model Runner Run, manage, and switch between a wide range of open‑source LLMs directly on your local machine. Ollama provides fast, offline inference with a simple CLI and API, ensuring your data never leaves the device. I

  6. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

More like LocalAI

7
W

whatcani.run

Find the best models and how to run them locally

Launch
8
L

Locally Uncensored

The all-in-one local AI studio for your desktop: chat

Launch
9
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
10
O

Open WebUI

Run AI on your own terms

Launch
11
C

ChatLLM-Web

Private local model studio, AI chat

Launch
12
L

LLM X

LLMX; Easiest 3rd party Local LLM UI for the web!

Launch
13
L

Llamastash

Zero-overhead, terminal-native local-LLM runtime manager

Launch
14
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
15
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
16
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
17
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
18
R

Reins

Local AI chat for iPhone, iPad and Mac

Launch
19
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
20
S

Smartloop Studio

Local AI Assistant

Launch
21
O

OpenLive

Opensource, on-device voice + vision layer for AI agents

Launch
22
L

Local Studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

Launch
23
L

Locally AI by LM Studio

Run AI models like Llama, Gemma, Qwen, and more on your iPhone and iPad

Launch
24
F

Fireworks AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed

Launch
25
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
26
O

OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server

Launch
27
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
28
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
29
L

llama.cpp

C/C++ inference engine for large language models, supporting quantization

Launch
30
N

Nativ

Run AI models locally

Launch
31
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
32
G

Gerbil

A desktop app for running Large Language Models locally

Launch
33
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
34
L

LocalAGI

LocalAGI is a powerful, self-hostable AI Agent platform

Launch
35
A

AgentOp

Run a real LLM in your browser. No install, no server

Launch
36
W

Web LLM

High-performance In-browser LLM Inference Engine

Launch
37
P

Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS

Launch
38
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
39
V

vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server

Launch
40
F

Fox

A local LLM server built for concurrent work

Launch
41
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
42
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
43
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
44
L

Localmee

18 top open-source AI models, curated and tested for your device

Launch
45
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
46
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
47
B

Biniou

a self-hosted webui for 30+ generative ai

Launch
48
M

Manifest

A complete backend in a single YAML file

Launch
49
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
50
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch

About LocalAI

L

LocalAI

Run LLMs, speech, image generation

LocalAI is an open-source, MIT-licensed AI engine that runs language models, speech, vision, image and video generation and agents on your own hardware. Its API is compatible with OpenAI, and the site says it also speaks the Anthropic, Ollama and ElevenLabs APIs, so most tools only need a new URL. The engine behind the API can be swapped. One model can run on llama.cpp while another runs on vLLM, SGLang or MLX, and clients see the same endpoint. A small core loads each engine as a separate backend only when a model needs it. The site says LocalAI works on any hardware, including CPU-only machines, and lists support for realtime voice, speech synthesis, object detection, depth estimation and image generation. Models are available with one click from a catalog of more than 1,000. The project is on GitHub, with documentation and a blog.

Price
Open source
Category
AI
Website
localai.io