Self-hosted alternatives to All LLM
200 self-hosted apps like All LLM, closest match first.
Top picks
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
FreeSelf-hosted
- P
Paddler
LaunchOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem.
FreeSelf-hosted
- O
OpenGateLLM
LaunchOpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a
FreeSelf-hosted
- L
Llmaker
LaunchModels, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
FreeSelf-hosted
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
FreeSelf-hosted
- R
Routerly.ai
LaunchSelf-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da
FreeSelf-hosted
More like All LLM
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
Alma by Olivares.AI
Self-hosted control plane that maps and governs what your AI agents can reach
Flamehaven-Filesearch
Self-hosted RAG search engine — 34 formats, BM25+hybrid search, multi-LLM…
About All LLM

All LLM
LLMs and AI Solutions: Empowering Businesses
Discover the Large Language Models at AllLLMs, your biggest LLM directory. Curated by John Rush list of LLMs for AI enthusiasts and experts.
- Price
- Paid
- Category
- AI
- Website
- llmmodels.org




