Skip to content
LLM Gateway

Free alternatives to LLM Gateway

200 free apps like LLM Gateway, closest match first.

Top picks

  1. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    FreeSelf-hosted

  2. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  3. O

    OmniKey-AI-Unified-Key-Manager

    Launch

    A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage

    FreeSelf-hosted

  4. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    FreeSelf-hosted

  5. B

    BricksLLM

    Launch

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open

    FreeSelf-hosted

  6. E

    Envoy AI Gateway

    Launch

    Agent Router, formerly Envoy AI Gateway, is an open-source control plane for routing AI and agent traffic, built on Envoy. Applications send requests to one OpenAI-compatible API, and the gateway routes them to the model provider you choose

    Free

More like LLM Gateway

7
M

Manifest

A complete backend in a single YAML file

Launch
8
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
9
N

neon-ai-gateway

One API and one credential for frontier and open-source LLMs

Get
10
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
11
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
12
O

One API

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google

Launch
13
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
14
L

LLM API

Free LLM API: 100+ models, one single interface, and smart cost-aware analytics

Launch
15
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
16
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
17
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
18
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
19
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
20
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
21
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
22
K

Keywords AI

Free LLM dashboard

Launch
23
A

AI Cost Board

One place to see all your LLM metrics in real time

Launch
24
P

Proxy

Local-first LLM proxy that meters what every agent run costs

Launch
25
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
26
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
27
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
28
A

API7 cloud

Deploy and manage projects effortlessly

Launch
29
M

MakeHub.ai

Your LLM traffic, always on the fastest & cheapest route

Launch
30
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
31
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
32
O

Openai Scala Client

Scala client for OpenAI API and other major LLM providers

Launch
33
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
34
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
35
O

OpenLLMetry

Open-source observability platform for LLMs using OpenTelemetry

Launch
36
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
37
C

cost-aware-llm-pipeline

Cost optimization patterns for LLM API usage

Get
38
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
39
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
40
A

AIClient2API

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro

Launch
41
A

azure-aigateway

Configure Azure API Management as an AI Gateway for models, MCP tools

Get
42
L

Latitude

AI Agent Observability & Monitoring

Launch
43
O

Omniai

OmniAI standardizes the APIs for multiple AI providers like OpenAI's Chat GPT

Launch
44
F

Frugon

Free, local, open-source LLM cost analyzer

Launch
45
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
46
T

Tokentap

Intercept LLM API traffic and visualize token usage in a real-time terminal…

Launch
47
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch
48
O

observability-llm-obs

Answer questions about LLM and agentic-application behavior

Get
49
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
50
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch

About LLM Gateway

L

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API

LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change only the base URL. The gateway tracks cost and latency per request, with breakdowns by model and provider, a project-level usage explorer, and monitoring of errors and reliability. Keys are managed centrally, so you do not juggle separate provider dashboards, and you can switch providers without changing your code. Guardrails, audit logs and SSO with roles are listed for teams that need them. You can run the gateway yourself under the AGPLv3 licence, or use the hosted cloud service. Bring your own provider keys for free, or pay per credit with a platform fee on credit usage. The site says it adds new model releases within 48 hours of launch and publishes uptime on a status page. It is aimed at teams that run several models and want one place to route, monitor and control them.

Price
Freemium
Category
AI
Website
llmgateway.io