Self-hosted alternatives to TensorZero
200 self-hosted apps like TensorZero, closest match first.
Top picks
- L

Langfuse
LaunchTrace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.
Open sourceSelf-hosted
- O
OpenGateLLM
LaunchOpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a
FreeOpen sourceSelf-hosted
- L
Llmaker
LaunchModels, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
FreeOpen sourceSelf-hosted
- T

TurboLLM
LaunchRun open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA
FreeOpen sourceSelf-hosted
- S

Spanlens
LaunchSpanlens is an observability platform for LLM applications that works with OpenAI, Anthropic and Gemini, and with other providers such as Groq, Mistral, xAI and OpenRouter. To start, you change one line of config, the provider base URL, and
Open sourceSelf-hosted
- R
Routerly.ai
LaunchSelf-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da
FreeOpen sourceSelf-hosted
More like TensorZero
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
Alma by Olivares.AI
Self-hosted control plane that maps and governs what your AI agents can reach
About TensorZero
TensorZero
Feedback loop for LLM applications: turn production data into smarter, faster
Feedback loop for LLM applications: turn production data into smarter, faster, and cheaper models
- Category
- AI
- Website
- tensorzero.com


