Self-hosted alternatives to Infere
200 self-hosted apps like Infere, closest match first.
Top picks
- L

Langfuse
LaunchTrace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.
Open sourceSelf-hosted
- S

Spanlens
LaunchSpanlens is an observability platform for LLM applications that works with OpenAI, Anthropic and Gemini, and with other providers such as Groq, Mistral, xAI and OpenRouter. To start, you change one line of config, the provider base URL, and
Open sourceSelf-hosted
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
FreeOpen sourceSelf-hosted
- L
Llmaker
LaunchModels, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
FreeOpen sourceSelf-hosted
- M

Muxi
LaunchMUXI is an open-source server for deploying AI agents in production. You describe agent formations in YAML, which are complete AI systems made of agents, auditable memory, tools, role-based access control and self-tuning, and deploy them wi
FreeOpen sourceSelf-hosted
- O
OpenGateLLM
LaunchOpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a
FreeOpen sourceSelf-hosted
More like Infere
Alma by Olivares.AI
Self-hosted control plane that maps and governs what your AI agents can reach

Inference Gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM…
About Infere

Infere
Platform for LLM observability, evaluators and git-like prompt management
Infere is an observability and monitoring platform built for large language models (LLMs). It provides a unified solution for LLM observability, monitoring, evaluation, and prompt management through a single OpenAI-compatible API.
- Price
- Freemium
- Category
- AI
- Website
- infere.com


