Skip to content
TensorZero

Self-hosted alternatives to TensorZero

200 self-hosted apps like TensorZero, closest match first.

Top picks

  1. L

    Langfuse

    Launch

    Trace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.

    Open sourceSelf-hosted

  2. O

    OpenGateLLM

    Launch

    OpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a

    FreeOpen sourceSelf-hosted

  3. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

    FreeOpen sourceSelf-hosted

  4. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

    FreeOpen sourceSelf-hosted

  5. S

    Spanlens

    Launch

    Spanlens is an observability platform for LLM applications that works with OpenAI, Anthropic and Gemini, and with other providers such as Groq, Mistral, xAI and OpenRouter. To start, you change one line of config, the provider base URL, and

    Open sourceSelf-hosted

  6. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    FreeOpen sourceSelf-hosted

More like TensorZero

7
L

LMRing

Open-source, self-hostable LLM arena

Launch
8
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
9
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
10
H

HappyTorch

A PyTorch coding practice platform — covering LLM, Diffusion, PEFT, and more…

Launch
11
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
12
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
13
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
14
G

GrayMatter

30 sec to give your AI agents persistent memory

Launch
15
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
16
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
17
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
18
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
19
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
20
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
21
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
22
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
23
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
24
T

Textgen

Open-source desktop app for local LLMs

Launch
25
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
26
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
27
Z

ZizkaDB

Audit trail database for AI agents

Launch
28
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
29
P

Pipelex

Build AI methods with your coding agent

Launch
30
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
31
M

Mnemory

A self-hosted, secure, feature-rich memory system for AI agents and assistants

Launch
32
M

Marm Memory

Local-first 3-in-1 AI memory layer & MCP server for Claude Code, Codex, Grok

Launch
33
L

Latitude

AI Agent Observability & Monitoring

Launch
34
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
35
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
36
Y

Yantrikdb Server

Cognitive memory database for AI agents

Launch
37
B

Basic Memory

AI conversations that actually remember

Launch
38
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
39
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
40
L

Lora Dataset Studio

Self-hosted, one-tab workbench for the whole training lifecycle: build…

Launch
41
Y

YourMemory

Agentic AI memory with Ebbinghaus forgetting curve decay

Launch
42
P

Promptmask

Never give AI companies your secrets

Launch
43
M

MindRoom

AI agents that know you and your work, in a chat app anyone can use

Launch
44
R

Roampal

Memory that learns what works

Launch
45
A

Alma by Olivares.AI

Self-hosted control plane that maps and governs what your AI agents can reach

Launch
46
D

Deepmem

Drop-in AI memory layer with 2x faster retrieval and 10x lower cost

Launch
47
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
48
M

MarketMAI

AI Newsletter

Launch
49
L

LoomFlow

Lightweight AI-native workflow builder for individuals and small teams

Launch
50
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch

About TensorZero

T

TensorZero

Feedback loop for LLM applications: turn production data into smarter, faster

Feedback loop for LLM applications: turn production data into smarter, faster, and cheaper models

Category
AI
Website
tensorzero.com