Skip to content
LLM Gateway

Self-hosted alternatives to LLM Gateway

200 self-hosted apps like LLM Gateway, closest match first.

Top picks

  1. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    FreeSelf-hosted

  2. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  3. O

    OmniKey-AI-Unified-Key-Manager

    Launch

    A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage

    FreeSelf-hosted

  4. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    FreeSelf-hosted

  5. B

    BricksLLM

    Launch

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open

    FreeSelf-hosted

  6. V

    VoidLLM

    Launch

    Privacy-first LLM proxy and AI gateway. Zero knowledge of your prompts. Load balancing, multi-provider routing (OpenAI, Anthropic, Azure, Ollama, vLLM), API key management, usage tracking, and rate limiting. Self-hosted.

    FreeSelf-hosted

More like LLM Gateway

7
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
8
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
9
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
10
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
11
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
12
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
13
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
14
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
15
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
16
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
17
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
18
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
19
A

API7 cloud

Deploy and manage projects effortlessly

Launch
20
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
21
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
22
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
23
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
24
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
25
A

AIClient2API

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro

Launch
26
L

Latitude

AI Agent Observability & Monitoring

Launch
27
A

Alma by Olivares.AI

Self-hosted control plane that maps and governs what your AI agents can reach

Launch
28
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
29
P

Proxify

An open-source, lightweight, and self-hosted reverse proxy gateway for AI APIs

Launch
30
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
31
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
32
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
33
C

Cloudflare AI Web

Cloudflare AI Platform with one-click deployment

Launch
34
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
35
T

TurboLLM

Run any local LLM engine, auto-tuned to your GPU

Launch
36
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
37
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
38
Q

Qwengate

Drop-in OpenAI-compatible API gateway for Qwen AI models

Launch
39
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
40
G

GPTPortal

A feature-rich portal to chat with GPT-4, Claude, Gemini, Mistral, & OpenAI…

Launch
41
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
42
L

LMRing

Open-source, self-hostable LLM arena

Launch
43
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
44
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
45
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
46
W

Webchat2api

OpenAI-compatible Web Chat API proxy

Launch
47
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
48
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
49
O

Open WebUI

Run AI on your own terms

Launch
50
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch

About LLM Gateway

L

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API

LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change only the base URL. The gateway tracks cost and latency per request, with breakdowns by model and provider, a project-level usage explorer, and monitoring of errors and reliability. Keys are managed centrally, so you do not juggle separate provider dashboards, and you can switch providers without changing your code. Guardrails, audit logs and SSO with roles are listed for teams that need them. You can run the gateway yourself under the AGPLv3 licence, or use the hosted cloud service. Bring your own provider keys for free, or pay per credit with a platform fee on credit usage. The site says it adds new model releases within 48 hours of launch and publishes uptime on a status page. It is aimed at teams that run several models and want one place to route, monitor and control them.

Price
Freemium
Category
AI
Website
llmgateway.io