LLM Gateway
Route, manage, and analyze LLM requests across multiple providers with one API
Freemium
Domain Rating
by Ahrefs
Domain Rating by Ahrefs58
Description
LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change only the base URL. The gateway tracks cost and latency per request, with breakdowns by model and provider, a project-level usage explorer, and monitoring of errors and reliability. Keys are managed centrally, so you do not juggle separate provider dashboards, and you can switch providers without changing your code. Guardrails, audit logs and SSO with roles are listed for teams that need them. You can run the gateway yourself under the AGPLv3 licence, or use the hosted cloud service. Bring your own provider keys for free, or pay per credit with a platform fee on credit usage. The site says it adds new model releases within 48 hours of launch and publishes uptime on a status page. It is aimed at teams that run several models and want one place to route, monitor and control them.…
Preview
Pricing
- Free$0
- EnterpriseCustom
Highlights
- One OpenAI-compatible API for 40+ providers
- Cost and latency analytics per request
- Bring your own keys for free
- Self-host under AGPLv3 or use the cloud
- Guardrails, audit logs and SSO
Ratings & Reviews
No ratings yet
Be the first to rate LLM Gateway.
People also visit
LLM Gateway FAQ
What is LLM Gateway?
It is an open source gateway that sends your AI requests to many models and providers through a single API, with analytics and key management.
Do I have to change my code?
The site says you keep your existing OpenAI SDK code and change only the base URL to start routing through the gateway.
Is it free?
Bringing your own provider keys is free. Cloud usage with credits has a flat 5 percent platform fee, and self-hosting the core gateway is possible under AGPLv3.
How does it differ from OpenRouter?
The FAQ says LLM Gateway can be fully self-hosted, gives deeper real-time cost and latency analytics, and offers free bring-your-own-keys.
What are the best LLM Gateway alternatives?
Popular alternatives to LLM Gateway include LiteLLM, Inference Gateway and GoModel. See all LLM Gateway alternatives




