Skip to content
Ollama

Self-hosted alternatives to Ollama

200 self-hosted apps like Ollama, closest match first.

Top picks

  1. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

    Free

  2. L

    LocalAI

    Launch

    LocalAI is an open-source, MIT-licensed AI engine that runs language models, speech, vision, image and video generation and agents on your own hardware. Its API is compatible with OpenAI, and the site says it also speaks the Anthropic, Olla

    Free

  3. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

    Free

  4. O

    Open WebUI

    Launch

    Open WebUI is a self-hosted AI platform for running and chatting with models on your own machine or server. It connects to local models and to cloud providers, including Ollama, OpenAI, Anthropic and any compatible API. You can extend it wi

    Free

  5. O

    OpenGateLLM

    Launch

    OpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a

    Free

  6. O

    overtchat

    Launch

    A polished, privacy-first Open WebUI alternative for local and hosted models, with multi-user accounts, realtime local voice, files, search, memory, and desktop and mobile apps.

    Free

More like Ollama

7
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
8
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
9
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
10
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
11
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
12
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
13
T

Textgen

Open-source desktop app for local LLMs

Launch
14
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
15
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
16
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
17
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
18
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
19
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
20
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
21
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
22
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
23
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
24
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
25
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
26
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
27
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
28
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
29
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
30
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
31
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
32
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
33
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
34
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
35
L

Latitude

AI Agent Observability & Monitoring

Launch
36
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
37
O

OpenOpenAI

Self-hosted version of OpenAI’s new stateful Assistants API

Launch
38
K

Kolosal AI

A software for local training, downloading

Launch
39
L

LLM Harbor

Containerized LLM toolkit

Launch
40
O

Olares

Open-Source Personal Cloud OS for Always-On Agents

Launch
41
L

Locally Uncensored

The all-in-one local AI studio for your desktop: chat

Launch
42
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
43
J

Jan

Jan runs open-source AI models on your own hardware or connects

Launch
44
P

Pocketpaw

Your AI agent in 30 seconds

Launch
45
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
46
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
47
C

Cezar

Open-source orchestrator and ADE for running Claude Code, Codex, OpenCode

Launch
48
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
49
H

Helix

Private Agent Fleet with Spec Coding

Launch
50
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch

About Ollama

O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Ollama is a tool for running open AI models on your own computer, from the terminal or through apps you build. It runs on macOS, Windows and Linux. When a model is too large for your hardware, cloud models are available too, paid for with usage credits. The site says prompts sent to its models are never stored or trained on. Its library holds many popular open models, and the site reports more than a billion model downloads. The free plan lets you run models locally, with starter credits for cloud models and access to starter models. Paid Pro, Max and Team plans add monthly usage credits, larger models and concurrent requests. The Team plan adds unlimited users, shared credits across a team, centralized billing and administration. Ollama also has a GitHub project, a Discord community, documentation and a blog.

Price
Freemium
Category
AI
Website
ollama.com