Skip to content
LiteLLM

Open source alternatives to LiteLLM

200 open source apps like LiteLLM, closest match first.

Top picks

  1. L

    LLM Gateway

    Launch

    LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o

  2. Y

    YoloRouter

    Launch

    Free, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.

    FreeSelf-hosted

  3. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    FreeSelf-hosted

  4. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  5. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    FreeSelf-hosted

  6. B

    BricksLLM

    Launch

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open

    FreeSelf-hosted

More like LiteLLM

7
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
8
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
9
M

Manifest

A complete backend in a single YAML file

Launch
10
E

Envoy AI Gateway

Open source gateway built on Envoy

Launch
11
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
12
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
13
P

Portkey

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps

Launch
14
P

Proxy

Local-first LLM proxy that meters what every agent run costs

Launch
15
O

One API

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google

Launch
16
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
17
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
18
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
19
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
20
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
21
M

Maxim AI

Enterprise AI Gateway Built for Scale

Launch
22
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
23
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
24
H

Helicone AI

The open-source LLM observability for developers

Launch
25
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
26
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
27
O

OpenLLMetry

Open-source observability platform for LLMs using OpenTelemetry

Launch
28
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
29
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
30
L

Llamastash

Zero-overhead, terminal-native local-LLM runtime manager

Launch
31
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
32
O

Openai Scala Client

Scala client for OpenAI API and other major LLM providers

Launch
33
O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

Launch
34
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
35
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
36
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
37
L

LibreChat

LibreChat is a free and open-source chat interface for assistant AIs

Launch
38
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
39
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
40
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
41
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
42
L

Lollms Hub

A proxy server for multiple ollama instances with Key security

Launch
43
O

Open WebUI

Run AI on your own terms

Launch
44
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
45
L

Latitude

AI Agent Observability & Monitoring

Launch
46
L

LocalAI

Run LLMs, speech, image generation

Launch
47
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
48
W

Web LLM

High-performance In-browser LLM Inference Engine

Launch
49
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
50
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch

About LiteLLM

L

LiteLLM

Acts as a unified proxy across 100+ LLMs

LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, rate limits, fallbacks and routing to the right model for each request. You can see every request, cap spending per key, team or model, and send traffic to a cheaper model when appropriate. It is MIT licensed and can be self-hosted in your own cloud or fully air-gapped. An Enterprise tier adds SSO, role-based access, audit logs, SCIM and dedicated support on the same open-source core. The site also offers a Python SDK for calling many models in the OpenAI format, and a liteagents SDK for routing agent turns across providers. The project is on GitHub, with a Discord community and a quickstart script for macOS, Linux and Windows.

Price
Freemium
Category
AI
Website
litellm.ai