Alternatives to Envoy AI Gateway
200 apps like Envoy AI Gateway, closest match first.
Top picks
- L

LLM Gateway
LaunchLLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o
- L

LiteLLM
LaunchLiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, r
- M

Manifest
LaunchThe open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.
- M

Maxim AI
LaunchBifrost, by Maxim AI, is an open-source AI gateway that sits in front of many model providers with one API. It offers a unified interface to more than 1,000 models from more than eight providers, with automatic fallbacks, budgets and rate l
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
Self-hosted
- Y
YoloRouter
LaunchFree, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.
Self-hosted
More like Envoy AI Gateway

Inference Gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM…
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
MCP Context Forge
An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or…
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
About Envoy AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy
Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.
- Price
- Open source
- Category
- AI
- Website
- envoyproxy.io








