Alternatives to LiteLLM
200 apps like LiteLLM, closest match first.
Top picks
- L

LLM Gateway
LaunchLLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o
- Y
YoloRouter
LaunchFree, open-source, self-hosted LLM gateway. Translate between OpenAI, Anthropic and Gemini protocols, fail over across providers, rotate upstream keys — with an admin console embedded in one binary. Install with one command.
FreeSelf-hosted
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
FreeSelf-hosted
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
FreeSelf-hosted
- R
Routerly.ai
LaunchSelf-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da
FreeSelf-hosted
- B
BricksLLM
Launch🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open
FreeSelf-hosted
More like LiteLLM
About LiteLLM
LiteLLM
Acts as a unified proxy across 100+ LLMs
LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, rate limits, fallbacks and routing to the right model for each request. You can see every request, cap spending per key, team or model, and send traffic to a cheaper model when appropriate. It is MIT licensed and can be self-hosted in your own cloud or fully air-gapped. An Enterprise tier adds SSO, role-based access, audit logs, SCIM and dedicated support on the same open-source core. The site also offers a Python SDK for calling many models in the OpenAI format, and a liteagents SDK for routing agent turns across providers. The project is on GitHub, with a Discord community and a quickstart script for macOS, Linux and Windows.
- Price
- Freemium
- Category
- AI
- Website
- litellm.ai







