Skip to content
Infere

Open source alternatives to Infere

200 open source apps like Infere, closest match first.

Top picks

  1. L

    Langfuse

    Launch

    Trace, evaluate, and improve AI agents with one open platform. Use production data to understand behavior, collaborate on fixes, and ship better quality at lower cost and latency.

    Open sourceSelf-hosted

  2. S

    Spanlens

    Launch

    Spanlens is an observability platform for LLM applications that works with OpenAI, Anthropic and Gemini, and with other providers such as Groq, Mistral, xAI and OpenRouter. To start, you change one line of config, the provider base URL, and

    Open sourceSelf-hosted

  3. L

    Langtrace

    Launch

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript,

    FreeOpen source

  4. I

    Inferock Bench

    Launch

    Choose observability with Inferock Watch, serverless inference with accountability through Inferock Serve, or dedicated inference with Inferock Dedicated.

    FreeOpen source

  5. L

    Litefuse

    Launch

    Ship reliable AI agents with evaluation-driven development. OpenTelemetry-native and Langfuse SDK compatible, powered by Apache Doris — lightweight deployment, 80% lower storage cost, built-in support for Claude Code, OpenClaw, and Hermes.

    FreeOpen source

  6. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeOpen sourceSelf-hosted

More like Infere

7
L

Llamafarm

Deploy any AI model, agent, database, RAG

Launch
8
T

Traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection

Launch
9
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
10
T

Tokentap

Intercept LLM API traffic and visualize token usage in a real-time terminal…

Launch
11
G

Geo Aeo Tracker

Open-source, local-first AI visibility intelligence dashboard

Launch
12
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
13
O

Opsrobot

Observability platform for Digital Employee, providing real-time tracing

Launch
14
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
15
T

Tracecrate

Local-first AI agent trace workbench

Launch
16
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
17
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
18
P

Prompttools

Open-source tools for prompt testing and experimentation

Launch
19
D

Dify

Open-source LLM app development platform

Launch
20
L

Latitude

AI Agent Observability & Monitoring

Launch
21
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
22
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
23
C

Chipper

AI interface for tinkerers (Ollama, Haystack RAG, Python)

Launch
24
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
25
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
26
F

Frugon

Free, local, open-source LLM cost analyzer

Launch
27
M

Misceo

Local Anthropic-compatible AI gateway

Launch
28
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
29
A

Aikit

Fine-tune, build, and deploy open-source LLMs easily!

Launch
30
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
31
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
32
L

Loongsuite Pilot

Local-first telemetry collector for AI coding agents

Launch
33
V

Vscode Unify Chat Provider

Integrate multiple LLM API providers into VS Code's GitHub Copilot Chat

Launch
34
P

PromptScript

Prompt-as-Code for Enterprise AI

Launch
35
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
36
S

Syrtis

AI token usage & quota monitor for the macOS menu bar

Launch
37
S

SillyTavern

LLM Frontend for Power Users

Launch
38
L

Ling Stack

Local-first AI teammate workspace

Launch
39
M

Manifest

A complete backend in a single YAML file

Launch
40
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
41
B

Bag of words

Chat with your data - with memory, rules, and observability built in

Launch
42
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
43
A

AI-Flow

Connect multiple AI models easily

Launch
44
P

Promptulate

Lightweight Large language model automation

Launch
45
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
46
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
47
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
48
H

Huf

Open-source, self-hosted multi-agent AI infrastructure for teams and apps

Launch
49
W

WebLLM Chat

Chat with AI large language models running natively in your browser

Launch
50
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch

About Infere

I

Infere

Platform for LLM observability, evaluators and git-like prompt management

Infere is an observability and monitoring platform built for large language models (LLMs). It provides a unified solution for LLM observability, monitoring, evaluation, and prompt management through a single OpenAI-compatible API.

Price
Freemium
Category
AI
Website
infere.com