Self-hosted alternatives to Envoy AI Gateway
200 self-hosted apps like Envoy AI Gateway, closest match first.
Top picks
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
Self-hosted
- Y
YoloRouter
LaunchFree, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.
Self-hosted
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Self-hosted
- O
OrcaRouter-Lite
LaunchOrcaRouter. OrcaRouter is an OpenAI-compatible API gateway that routes each request across 200+ large language models through a single endpoint. Instead of integrating and paying for every provider separately, you point your app at one URL
Self-hosted
- G
GPT Load
LaunchGPT-Load is a self-hosted AI gateway. It puts many model channels and credentials behind one base URL, so applications only need the base URL and an access key. The gateway handles scheduling across API keys and subscription accounts, retri
Self-hosted
- R
Routerly.ai
LaunchSelf-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da
Self-hosted
More like Envoy AI Gateway
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
Alma by Olivares.AI
Self-hosted control plane that maps and governs what your AI agents can reach
About Envoy AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy
Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.
- Price
- Open source
- Category
- AI
- Website
- envoyproxy.io


