Skip to content
Envoy AI Gateway

Alternatives to Envoy AI Gateway

200 apps like Envoy AI Gateway, closest match first.

Top picks

  1. L

    LLM Gateway

    Launch

    LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o

  2. L

    LiteLLM

    Launch

    LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, r

  3. M

    Manifest

    Launch

    The open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.

  4. M

    Maxim AI

    Launch

    Bifrost, by Maxim AI, is an open-source AI gateway that sits in front of many model providers with one API. It offers a unified interface to more than 1,000 models from more than eight providers, with automatic fallbacks, budgets and rate l

  5. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    Self-hosted

  6. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    Self-hosted

More like Envoy AI Gateway

7
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
8
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
9
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
10
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
11
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
12
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch
13
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
14
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
15
P

Proxify

An open-source, lightweight, and self-hosted reverse proxy gateway for AI APIs

Launch
16
T

TrustedRouter

A privacy-first API gateway routing 600+ AI models without logging

Launch
17
A

AISIX AI Gateway

Open-source AI gateway for LLMs & AI agents, built in Rust

Get
18
M

MCP Context Forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or…

Launch
19
P

Portkey

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps

Launch
20
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
21
G

GoModel

AI gateway / AI control plane / AI proxy written in Go

Get
22
O

OpenRouter

The unified interface for every model

Launch
23
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
24
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
25
E

Experiential Labs

Open source AI gateway that turns your traffic into better models

Launch
26
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
27
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
28
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
29
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
30
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
31
A

Archestra

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Launch
32
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
33
O

Openagent

next-generation personal AI assistant powered by LLM, RAG and agent loops

Launch
34
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
35
A

azure-aigateway

Configure Azure API Management as an AI Gateway for models, MCP tools

Get
36
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
37
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
38
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
39
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
40
M

Mission Control

Self-hosted control plane for AI agents: dispatch tasks, review runs

Launch
41
S

Synaplan

Our AI control plane for fast deployment

Launch
42
N

neon-ai-gateway

One API and one credential for frontier and open-source LLMs

Get
43
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
44
O

Octomind

Open-source AI coding agent and agent runtime: one binary, any model, MCP-native

Launch
45
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
46
L

LangWatch

AI Agent Testing and Evaluation

Launch
47
O

opencodex

Universal provider proxy for OpenAI Codex & Claude Code

Launch
48
Y

Yoagent

The agent loop for Rust — stream from 7 LLM protocols, run tools, loop until…

Launch
49
A

Adrian

Open-source runtime AI agent security tool

Launch
50
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch

About Envoy AI Gateway

E

Envoy AI Gateway

Open source gateway built on Envoy

Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.

Price
Open source
Category
AI
Website
envoyproxy.io