Skip to content
L

LiteLLM

Acts as a unified proxy across 100+ LLMs

Freemium

#36in AI
1In stores

Description

LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI for…

Preview

Highlights

  • One OpenAI-compatible API for 100+ LLMs
  • Spend tracking and budgets
  • Virtual keys and rate limits
  • Fallbacks and model routing
  • Self-hosted, including air-gapped

Ratings & Reviews

No ratings yet

Be the first to rate LiteLLM.

People also visit

L

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API

AI
Launch
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

AI
Launch
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

AI
Launch
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

AI
Launch
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

AI
Launch
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

AI
Launch

LiteLLM FAQ

What is LiteLLM?

An open-source AI gateway and LLM proxy that gives one OpenAI-compatible API for many model providers.

Is it free?

The gateway is MIT licensed and free to self-host. An Enterprise tier adds SSO, RBAC, audit logs and support.

Can I track costs?

Yes. The site says you can track and cap spend per key, team and model.

Can I self-host it?

Yes. It can run in your own cloud or in a fully air-gapped environment.

How do I start?

Use the quickstart script on macOS and Linux, or install the Python SDK.

What are the best LiteLLM alternatives?

Popular alternatives to LiteLLM include LLM Gateway, YoloRouter and Inference Gateway. See all LiteLLM alternatives

Developer Stuff

Badges