Self-hosted alternatives to Baseten
200 self-hosted apps like Baseten, closest match first.
Top picks
- G
GoModel
LaunchAI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,
FreeSelf-hosted
- O
ObsidianArc
LaunchObsidian Arc is a self-hosted AI workspace that runs as a single Go program with a Vue web interface. You deploy one instance on your own server, choose SQLite or PostgreSQL for storage, then set up model providers, users and quotas from th
FreeSelf-hosted
- R
Routerly.ai
LaunchSelf-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da
FreeSelf-hosted
- I

Inference Gateway
LaunchAn open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
FreeSelf-hosted
- L

LLMKube
LaunchLLMKube is a Kubernetes operator for running language models on your own hardware. You write a Model resource and an InferenceService resource in YAML, and the operator serves the model behind an OpenAI-compatible endpoint once it is ready.
FreeSelf-hosted
- W
Willow Inference Server
LaunchWillow Inference Server (WIS) is an open-source server that runs speech and language models on your own hardware. It handles speech recognition, text-to-speech and language model inference, and it accepts audio over WebRTC, REST and WebSock
FreeSelf-hosted
More like Baseten
About Baseten
Baseten
Inference Platform: Deploy AI models in production
Baseten is an inference platform for serving and scaling open-source, custom and fine-tuned AI models in production. You can deploy models on dedicated infrastructure for high-scale workloads, or use pre-optimised Model APIs to try models such as GLM, DeepSeek and Kimi without setting up infrastructure. The platform includes fast cold starts, autoscaling, cross-cloud high availability and runtimes for image generation, transcription, text-to-speech, LLMs and embeddings. Training is available with the Loops SDK, and the same stack can serve the trained models. Deployment can run in Baseten's cloud, in your own VPC, or in a hybrid setup. The Basic plan is $0 a month with pay-as-you-go pricing, and includes dedicated deployments, Model APIs and training, with SOC 2 Type II and HIPAA compliance. Pro adds priority GPU access and dedicated support, and Enterprise adds custom SLAs, self-hosted deployments and data residency controls, priced by quote.
- Price
- Freemium
- Category
- AI
- Website
- baseten.co


