Skip to content
Baseten

Self-hosted alternatives to Baseten

200 self-hosted apps like Baseten, closest match first.

Top picks

  1. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  2. O

    ObsidianArc

    Launch

    Obsidian Arc is a self-hosted AI workspace that runs as a single Go program with a Vue web interface. You deploy one instance on your own server, choose SQLite or PostgreSQL for storage, then set up model providers, users and quotas from th

    FreeSelf-hosted

  3. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    FreeSelf-hosted

  4. I

    Inference Gateway

    Launch

    An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

    FreeSelf-hosted

  5. L

    LLMKube

    Launch

    LLMKube is a Kubernetes operator for running language models on your own hardware. You write a Model resource and an InferenceService resource in YAML, and the operator serves the model behind an OpenAI-compatible endpoint once it is ready.

    FreeSelf-hosted

  6. W

    Willow Inference Server

    Launch

    Willow Inference Server (WIS) is an open-source server that runs speech and language models on your own hardware. It handles speech recognition, text-to-speech and language model inference, and it accepts audio over WebRTC, REST and WebSock

    FreeSelf-hosted

More like Baseten

7
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
8
A

Alien

Infrastructure for managed self-hosting

Launch
9
C

Cloudflare AI Web

Cloudflare AI Platform with one-click deployment

Launch
10
O

Open WebUI

Run AI on your own terms

Launch
11
L

Latitude

AI Agent Observability & Monitoring

Launch
12
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
13
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
14
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
15
B

Beam

Run GPU inference, task queues, and sandboxes on serverless infrastructure

Launch
16
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
17
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
18
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
19
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
20
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
21
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
22
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
23
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
24
1

1backend

Build AI (or any) apps with scalable microservices & microfrontends

Launch
25
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
26
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
27
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
28
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
29
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
30
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
31
B

BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or…

Launch
32
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
33
S

Synaplan

Our AI control plane for fast deployment

Launch
34
S

Sipp

AI inference, packed simply

Launch
35
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
36
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
37
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
38
T

TurboLLM

Run any local LLM engine, auto-tuned to your GPU

Launch
39
R

Rivet

Deploy and scale AI agents, workloads, and backends anywhere

Launch
40
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
41
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
42
A

API7 cloud

Deploy and manage projects effortlessly

Launch
43
1

1flowbase

Build for agents — from the AI Gateway to the entire application stack

Launch
44
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
45
L

LocalAI

Run LLMs, speech, image generation

Launch
46
P

Pipelex

Build AI methods with your coding agent

Launch
47
H

Helix

Private Agent Fleet with Spec Coding

Launch
48
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
49
P

Prediction Guard

Seamlessly integrate private, controlled

Launch
50
S

Selfhost AI

One-command installer for a self-hosted AI stack on your own server: n8n

Launch

About Baseten

B

Baseten

Inference Platform: Deploy AI models in production

Baseten is an inference platform for serving and scaling open-source, custom and fine-tuned AI models in production. You can deploy models on dedicated infrastructure for high-scale workloads, or use pre-optimised Model APIs to try models such as GLM, DeepSeek and Kimi without setting up infrastructure. The platform includes fast cold starts, autoscaling, cross-cloud high availability and runtimes for image generation, transcription, text-to-speech, LLMs and embeddings. Training is available with the Loops SDK, and the same stack can serve the trained models. Deployment can run in Baseten's cloud, in your own VPC, or in a hybrid setup. The Basic plan is $0 a month with pay-as-you-go pricing, and includes dedicated deployments, Model APIs and training, with SOC 2 Type II and HIPAA compliance. Pro adds priority GPU access and dedicated support, and Enterprise adds custom SLAs, self-hosted deployments and data residency controls, priced by quote.

Price
Freemium
Category
AI
Website
baseten.co