Skip to content
Envoy AI Gateway

Open source alternatives to Envoy AI Gateway

200 open source apps like Envoy AI Gateway, closest match first.

Top picks

  1. L

    LLM Gateway

    Launch

    LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o

  2. L

    LiteLLM

    Launch

    LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, r

  3. M

    Manifest

    Launch

    The open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.

  4. M

    Maxim AI

    Launch

    Bifrost, by Maxim AI, is an open-source AI gateway that sits in front of many model providers with one API. It offers a unified interface to more than 1,000 models from more than eight providers, with automatic fallbacks, budgets and rate l

  5. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    Self-hosted

  6. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    Self-hosted

More like Envoy AI Gateway

7
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
8
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
9
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
10
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
11
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
12
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch
13
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
14
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
15
M

MCP Context Forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or…

Launch
16
P

Portkey

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps

Launch
17
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
18
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
19
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
20
E

Experiential Labs

Open source AI gateway that turns your traffic into better models

Launch
21
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
22
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
23
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
24
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
25
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
26
A

Archestra

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Launch
27
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
28
O

Openagent

next-generation personal AI assistant powered by LLM, RAG and agent loops

Launch
29
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
30
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
31
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
32
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
33
M

Mission Control

Self-hosted control plane for AI agents: dispatch tasks, review runs

Launch
34
S

Synaplan

Our AI control plane for fast deployment

Launch
35
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
36
O

Octomind

Open-source AI coding agent and agent runtime: one binary, any model, MCP-native

Launch
37
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
38
L

LangWatch

AI Agent Testing and Evaluation

Launch
39
O

opencodex

Universal provider proxy for OpenAI Codex & Claude Code

Launch
40
Y

Yoagent

The agent loop for Rust — stream from 7 LLM protocols, run tools, loop until…

Launch
41
A

Adrian

Open-source runtime AI agent security tool

Launch
42
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
43
G

Grepture

An AI gateway that sits on the request path to handle PII redaction

Launch
44
H

HarnessRouter

HarnessRouter Community Edition: the self-hosted

Launch
45
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
46
A

Agent Kernel

The Operating System for Scalable Enterprise AI Agents

Launch
47
K

Kortix

Manages a team of AI agents across your company

Launch
48
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
49
L

Litefuse

Agent Observability and Evaluation Platform

Launch
50
D

DashClaw

Remote approvals, policy checks, and execution evidence for unattended AI agents

Launch

About Envoy AI Gateway

E

Envoy AI Gateway

Open source gateway built on Envoy

Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.

Price
Open source
Category
AI
Website
envoyproxy.io