Skip to content
Infere

Self-hosted alternatives to Infere

200 self-hosted apps like Infere, closest match first.

Top picks

  1. L

    Langfuse

    Launch

    Trace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.

    Open sourceSelf-hosted

  2. S

    Spanlens

    Launch

    Spanlens is an observability platform for LLM applications that works with OpenAI, Anthropic and Gemini, and with other providers such as Groq, Mistral, xAI and OpenRouter. To start, you change one line of config, the provider base URL, and

    Open sourceSelf-hosted

  3. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeOpen sourceSelf-hosted

  4. L

    Llmaker

    Launch

    Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.

    FreeOpen sourceSelf-hosted

  5. M

    Muxi

    Launch

    MUXI is an open-source server for deploying AI agents in production. You describe agent formations in YAML, which are complete AI systems made of agents, auditable memory, tools, role-based access control and self-tuning, and deploy them wi

    FreeOpen sourceSelf-hosted

  6. O

    OpenGateLLM

    Launch

    OpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a

    FreeOpen sourceSelf-hosted

More like Infere

7
L

Latitude

AI Agent Observability & Monitoring

Launch
8
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
9
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
10
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
11
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
12
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
13
A

Alma by Olivares.AI

Self-hosted control plane that maps and governs what your AI agents can reach

Launch
14
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
15
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
16
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
17
H

Huf

Open-source, self-hosted multi-agent AI infrastructure for teams and apps

Launch
18
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
19
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
20
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
21
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
22
L

LMRing

Open-source, self-hostable LLM arena

Launch
23
P

Prediction Guard

Seamlessly integrate private, controlled

Launch
24
L

LLMKube

Kubernetes operator for self-hosted LLM inference with pluggable runtimes

Launch
25
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
26
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
27
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
28
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
29
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
30
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
31
T

Token Monitor

Local-first desktop widget for tracking token usage, costs, limits

Launch
32
S

Skyflo

Self-Hosted AI Agent for Kubernetes & DevOps

Launch
33
R

Runsight

Design and manage AI agent workflows

Launch
34
A

AiSOC

Open-source AI Security Operations Center: alert fusion, LLM-agent triage

Launch
35
A

AgentsMesh

Self-hostable AI Agent Workforce Platform

Launch
36
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
37
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
38
M

Marm Memory

Local-first 3-in-1 AI memory layer & MCP server for Claude Code, Codex, Grok

Launch
39
S

Synapse

Self-hosted AI workspace with shareable AI teammates, shared conversations

Launch
40
S

SignetAI

Sync and store memories, shared identity files

Launch
41
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
42
A

AIClient2API

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro

Launch
43
D

Deft

Self-hostable AGPL workspace where humans and AI agents share chat, tasks

Launch
44
A

Agentic Signal

Visual AI agent workflow automation platform with local LLM integration

Launch
45
B

BugTraceAI

Open-source, self-hosted web pentesting suite

Launch
46
P

Pocketpaw

Your AI agent in 30 seconds

Launch
47
P

Pad

Project Management for the agent era

Launch
48
A

ArkhamMirror

Local-first AI-powered document intelligence platform

Launch
49
A

API7 cloud

Deploy and manage projects effortlessly

Launch
50
L

LoomFlow

Lightweight AI-native workflow builder for individuals and small teams

Launch

About Infere

I

Infere

Platform for LLM observability, evaluators and git-like prompt management

Infere is an observability and monitoring platform built for large language models (LLMs). It provides a unified solution for LLM observability, monitoring, evaluation, and prompt management through a single OpenAI-compatible API.

Price
Freemium
Category
AI
Website
infere.com