Free alternatives to Envoy AI Gateway
200 free apps like Envoy AI Gateway, closest match first.
Top picks
- M

Manifest
LaunchThe open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
Self-hosted
- Y
YoloRouter
LaunchFree, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.
Self-hosted
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Self-hosted
- O
OrcaRouter-Lite
LaunchOrcaRouter. OrcaRouter is an OpenAI-compatible API gateway that routes each request across 200+ large language models through a single endpoint. Instead of integrating and paying for every provider separately, you point your app at one URL
Self-hosted
- F

Fastllm-proxy
LaunchThe lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets an
More like Envoy AI Gateway
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
MCP Context Forge
An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or…
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
About Envoy AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy
Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.
- Price
- Open source
- Category
- AI
- Website
- envoyproxy.io







