Self-hosted alternatives to Portkey
200 self-hosted apps like Portkey, closest match first.
Top picks
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
FreeSelf-hosted
- O

OmniKey-AI-Unified-Key-Manager
LaunchA self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage
FreeSelf-hosted
- B
BricksLLM
Launch🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open
FreeSelf-hosted
- T
The OSS LLMOps Stack
LaunchModular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance eval
FreeSelf-hosted
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
FreeSelf-hosted
- O
OpenGateLLM
LaunchOpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a
FreeSelf-hosted
More like Portkey
Alma by Olivares.AI
Self-hosted control plane that maps and governs what your AI agents can reach
About Portkey

Portkey
Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps
Portkey is a production platform for teams building apps on large language models. It combines an AI gateway, observability, guardrails, prompt management and governance in one product. The gateway gives a universal API to access more than 1,600 LLMs, with fallbacks, load balancing, retries and caching, and key management in one place. Observability records logs and traces for each request, with feedback, custom metadata, filters and alerts, so teams can monitor behavior and catch anomalies and usage spikes early. Prompt management provides templates, a playground, API endpoints, versioning and variables for prompts. Guardrails add deterministic checks and, on higher plans, LLM and partner guardrails. Team features include role-based access control and service account API keys. The site lists plans from a free developer tier for prototyping, to a production plan with more logs and longer retention, up to custom enterprise pricing. The site also notes that Portkey is now marketed as the PRISMA AIRS AI Gateway for enterprises.
- Price
- Freemium
- Category
- AI
- Website
- portkey.ai


