Skip to content
Envoy AI Gateway

Free alternatives to Envoy AI Gateway

200 free apps like Envoy AI Gateway, closest match first.

Top picks

  1. M

    Manifest

    Launch

    The open source LLM router that connects your AI agents and harnesses to any provider in seconds. Subscriptions, pay-per-token, local models, and custom providers.

  2. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    Self-hosted

  3. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    Self-hosted

  4. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    Self-hosted

  5. O

    OrcaRouter-Lite

    Launch

    OrcaRouter. OrcaRouter is an OpenAI-compatible API gateway that routes each request across 200+ large language models through a single endpoint. Instead of integrating and paying for every provider separately, you point your app at one URL

    Self-hosted

  6. F

    Fastllm-proxy

    Launch

    The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets an

More like Envoy AI Gateway

7
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
8
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
9
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch
10
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
11
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
12
P

Proxify

An open-source, lightweight, and self-hosted reverse proxy gateway for AI APIs

Launch
13
M

MCP Context Forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or…

Launch
14
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
15
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
16
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
17
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
18
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
19
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
20
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
21
A

Archestra

Enterprise AI Platform with guardrails, MCP registry, gateway & orchestrator

Launch
22
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
23
O

Openagent

next-generation personal AI assistant powered by LLM, RAG and agent loops

Launch
24
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
25
A

azure-aigateway

Configure Azure API Management as an AI Gateway for models, MCP tools

Get
26
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
27
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
28
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
29
M

Mission Control

Self-hosted control plane for AI agents: dispatch tasks, review runs

Launch
30
S

Synaplan

Our AI control plane for fast deployment

Launch
31
N

neon-ai-gateway

One API and one credential for frontier and open-source LLMs

Get
32
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
33
O

Octomind

Open-source AI coding agent and agent runtime: one binary, any model, MCP-native

Launch
34
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
35
O

opencodex

Universal provider proxy for OpenAI Codex & Claude Code

Launch
36
Y

Yoagent

The agent loop for Rust — stream from 7 LLM protocols, run tools, loop until…

Launch
37
A

Adrian

Open-source runtime AI agent security tool

Launch
38
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
39
H

HarnessRouter

HarnessRouter Community Edition: the self-hosted

Launch
40
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
41
A

Agent Kernel

The Operating System for Scalable Enterprise AI Agents

Launch
42
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
43
L

Litefuse

Agent Observability and Evaluation Platform

Launch
44
T

Tokenbank

Token Bank — the local LLM gateway that sits between your AI agents and every…

Launch
45
O

Opengeni

Open, self-hostable agentic service for organizations

Launch
46
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
47
O

One API

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google

Launch
48
F

Foundry

The foundation layer for agentic intelligence

Launch
49
L

Lollms Hub

A proxy server for multiple ollama instances with Key security

Launch
50
A

aweb

Communication for AI agents: stable identity, durable mail and chat

Launch

About Envoy AI Gateway

E

Envoy AI Gateway

Open source gateway built on Envoy

Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose, so you can switch models without rewriting your code. The site says it supports more than 16 LLM providers, including OpenAI, Anthropic and AWS Bedrock, and that provider credentials stay out of your code. It also routes calls to MCP tools through one router, and it provides traffic management, inference-aware routing and observability, from a laptop to production. The project has moved into the Agentic AI Foundation, with the same code and maintainers. Several companies sell products built on it, and the project publishes release notes, a weekly community meeting and talks.

Price
Open source
Category
AI
Website
envoyproxy.io