Skip to content
Envoy AI Gateway

Self-hosted alternatives to Envoy AI Gateway

200 self-hosted apps like Envoy AI Gateway, closest match first.

Top picks

  1. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    Self-hosted

  2. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    Self-hosted

  3. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    Self-hosted

  4. O

    OrcaRouter-Lite

    Launch

    OrcaRouter. OrcaRouter is an OpenAI-compatible API gateway that routes each request across 200+ large language models through a single endpoint. Instead of integrating and paying for every provider separately, you point your app at one URL

    Self-hosted

  5. G

    GPT Load

    Launch

    GPT-Load is a self-hosted AI gateway. It puts many model channels and credentials behind one base URL, so applications only need the base URL and an access key. The gateway handles scheduling across API keys and subscription accounts, retri

    Self-hosted

  6. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    Self-hosted

More like Envoy AI Gateway

7
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
8
P

Proxify

An open-source, lightweight, and self-hosted reverse proxy gateway for AI APIs

Launch
9
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
10
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
11
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
12
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
13
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
14
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
15
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
16
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
17
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
18
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
19
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
20
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
21
M

Mission Control

Self-hosted control plane for AI agents: dispatch tasks, review runs

Launch
22
S

Synaplan

Our AI control plane for fast deployment

Launch
23
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
24
A

Adrian

Open-source runtime AI agent security tool

Launch
25
H

HarnessRouter

HarnessRouter Community Edition: the self-hosted

Launch
26
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
27
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
28
O

Opengeni

Open, self-hostable agentic service for organizations

Launch
29
A

aweb

Communication for AI agents: stable identity, durable mail and chat

Launch
30
S

Switch

Connect any AI agent to your team in Slack, Teams & Discord

Launch
31
P

Prismor

Self-hosted runtime control plane for AI agents

Launch
32
A

Alma by Olivares.AI

Self-hosted control plane that maps and governs what your AI agents can reach

Launch
33
1

1flowbase

Build for agents — from the AI Gateway to the entire application stack

Launch
34
C

Cloudflare AI Web

Cloudflare AI Platform with one-click deployment

Launch
35
A

AgentsMesh

Self-hostable AI Agent Workforce Platform

Launch
36
C

Coddy Agent

General-purpose agent in one static Go binary: console TUI

Launch
37
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
38
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
39
O

Open WebUI

Run AI on your own terms

Launch
40
O

Octo Agent

Open-source, single-binary, self-hosted AI agent

Launch
41
L

Lmnr

Laminar - open-source observability platform purpose-built for AI agents

Launch
42
A

Agenvoy

Self-hosted 24/7 personal AI agent that runs on your own machine

Launch
43
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
44
P

Pad

Project Management for the agent era

Launch
45
V

Valmis

The AI Agent designed for work with security in mind

Launch
46
O

Open Multi-Agent

Self-hosted TypeScript agent runtime

Launch
47
A

API7 cloud

Deploy and manage projects effortlessly

Launch
48
C

Commonly

Open-source room for humans + cross-vendor AI agents

Launch
49
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
50
O

Open Managed Agents

An open-source alternative to Claude Managed Agents and…

Launch

About Envoy AI Gateway

E

Envoy AI Gateway

Open source gateway built on Envoy

Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.

Price
Open source
Category
AI
Website
envoyproxy.io