Description
Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.…
Preview
Highlights
- One OpenAI-compatible API
- More than 16 LLM providers
- Credentials kept out of your code
- Routing for MCP tools
- Traffic management and observability
Ratings & Reviews
No ratings yet
Be the first to rate Envoy AI Gateway.
People also visit
Envoy AI Gateway FAQ
Is it open source?
Yes. The site describes it as an open-source control plane, and the code is on GitHub.
Which models can it route to?
The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock.
Do I need to change my code to switch models?
The site says you integrate once and switch models without rewriting your application.
What was it called before?
Envoy AI Gateway. The site says it is the same code and maintainers, now as Agent Router.
What are the best Envoy AI Gateway alternatives?
Popular alternatives to Envoy AI Gateway include LLM Gateway, LiteLLM and Manifest. See all Envoy AI Gateway alternatives





