Skip to content
Portkey

Open source alternatives to Portkey

200 open source apps like Portkey, closest match first.

Top picks

  1. L

    LLM Gateway

    Launch

    LLM Gateway is an open source API gateway that routes requests to more than 250 AI models from over 40 providers, including OpenAI, Anthropic and Google, through one OpenAI-compatible API. You keep your existing OpenAI SDK code and change o

  2. L

    LiteLLM

    Launch

    LiteLLM is an open-source AI gateway that puts many LLM providers behind one OpenAI-compatible API. It normalizes requests to the OpenAI format across more than 100 providers and gives platform teams virtual keys, spend tracking, budgets, r

  3. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  4. O

    OmniKey-AI-Unified-Key-Manager

    Launch

    A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoints. Routes requests dynamically across 12+ LLM platforms with automatic fallback, key scheduling, rate-limit tracking and encrypted credential storage

    FreeSelf-hosted

  5. B

    BricksLLM

    Launch

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open

    FreeSelf-hosted

  6. T

    The OSS LLMOps Stack

    Launch

    Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance eval

    FreeSelf-hosted

More like Portkey

7
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
8
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
9
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
10
H

Helicone AI

The open-source LLM observability for developers

Launch
11
E

Envoy AI Gateway

Open source gateway built on Envoy

Launch
12
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
13
O

One API

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google

Launch
14
M

Manifest

A complete backend in a single YAML file

Launch
15
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
16
G

GPT Load

Self-hosted AI gateway for multi-channel, multi-credential setups

Launch
17
O

OpenLLMetry

Open-source observability platform for LLMs using OpenTelemetry

Launch
18
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
19
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
20
P

Pezzo

Open-source, developer-first LLMOps platform

Launch
21
M

Maxim AI

Enterprise AI Gateway Built for Scale

Launch
22
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
23
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
24
L

LangWatch

AI Agent Testing and Evaluation

Launch
25
A

Agenta

Open-source LLMOps platform for prompt management, LLM evaluation

Launch
26
D

Dify

Open-source LLM app development platform

Launch
27
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
28
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
29
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
30
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
31
L

liter-llm

Universal LLM API client — 163 providers, 14 native language bindings…

Launch
32
O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

Launch
33
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
34
L

Latitude

AI Agent Observability & Monitoring

Launch
35
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
36
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
37
P

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models…

Launch
38
P

Prismor

Self-hosted runtime control plane for AI agents

Launch
39
T

Tyk API Management

API Management Platform & API Gateway

Launch
40
M

MLFlow

Track, store, visualize, analyze

Launch
41
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
42
O

OctoBus

A secure local gateway for AI agents to reliably call approved enterprise APIs

Launch
43
L

Lollms Hub

A proxy server for multiple ollama instances with Key security

Launch
44
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
45
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
46
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
47
L

Litefuse

Agent Observability and Evaluation Platform

Launch
48
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
49
P

Proxy

Local-first LLM proxy that meters what every agent run costs

Launch
50
L

Lmnr

Laminar - open-source observability platform purpose-built for AI agents

Launch

About Portkey

P

Portkey

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps

Portkey is a production platform for teams building apps on large language models. It combines an AI gateway, observability, guardrails, prompt management and governance in one product. The gateway gives a universal API to access more than 1,600 LLMs, with fallbacks, load balancing, retries and caching, and key management in one place. Observability records logs and traces for each request, with feedback, custom metadata, filters and alerts, so teams can monitor behavior and catch anomalies and usage spikes early. Prompt management provides templates, a playground, API endpoints, versioning and variables for prompts. Guardrails add deterministic checks and, on higher plans, LLM and partner guardrails. Team features include role-based access control and service account API keys. The site lists plans from a free developer tier for prototyping, to a production plan with more logs and longer retention, up to custom enterprise pricing. The site also notes that Portkey is now marketed as the PRISMA AIRS AI Gateway for enterprises.

Price
Freemium
Category
AI
Website
portkey.ai