Skip to content
All LLM

Self-hosted alternatives to All LLM

200 self-hosted apps like All LLM, closest match first.

Top picks

  1. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    FreeSelf-hosted

  2. P

    Paddler

    Launch

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem.

    FreeSelf-hosted

  3. O

    OpenGateLLM

    Launch

    OpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a

    FreeSelf-hosted

  4. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

    FreeSelf-hosted

  5. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  6. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    FreeSelf-hosted

More like All LLM

7
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
8
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
9
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
10
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
11
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
12
L

LMRing

Open-source, self-hostable LLM arena

Launch
13
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
14
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
15
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
16
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
17
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
18
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
19
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
20
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
21
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
22
L

LLM LS

LSP server leveraging LLMs for code completion (and more?)

Launch
23
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
24
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
25
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
26
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
27
A

Alma by Olivares.AI

Self-hosted control plane that maps and governs what your AI agents can reach

Launch
28
G

GPTPortal

A feature-rich portal to chat with GPT-4, Claude, Gemini, Mistral, & OpenAI…

Launch
29
O

Os1

the next-gen open source AI platform

Launch
30
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
31
O

OneGlanse

Open-source AI visibility, AEO & GEO tracker

Launch
32
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
33
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
34
M

MindRoom

AI agents that know you and your work, in a chat app anyone can use

Launch
35
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
36
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
37
A

API7 cloud

Deploy and manage projects effortlessly

Launch
38
P

Pocketpaw

Your AI agent in 30 seconds

Launch
39
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
40
F

Flamehaven-Filesearch

Self-hosted RAG search engine — 34 formats, BM25+hybrid search, multi-LLM…

Launch
41
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
42
F

Free-GPT4-WEB-API

Not just GPT4! Easy to use, Self-Hosted

Launch
43
A

Aikeedo

Launch your own AI SaaS, branded and self-hosted

Launch
44
L

Latitude

AI Agent Observability & Monitoring

Launch
45
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
46
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
47
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
48
L

LangGraph-GUI

Visual node-edge graph GUI editor for LangGraph and run

Launch
49
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
50
A

AIClient2API

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro

Launch

About All LLM

A

All LLM

LLMs and AI Solutions: Empowering Businesses

Discover the Large Language Models at AllLLMs, your biggest LLM directory. Curated by John Rush list of LLMs for AI enthusiasts and experts.

Price
Paid
Category
AI
Website
llmmodels.org