Skip to content
Baseten

Open source alternatives to Baseten

200 open source apps like Baseten, closest match first.

Top picks

  1. C

    Coai

    Launch

    🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, C

    Free

  2. B

    BaseAI

    Launch

    BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

    Free

  3. G

    GoModel

    Launch

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming,

    FreeSelf-hosted

  4. C

    Cloudoora GenAI Platform

    Launch

    Deploy and scale open-source AI applications on cloud, VPS, dedicated, or on-premises infrastructure with Cloudoora's Enterprise GenAI Platform.

    Free

  5. L

    Llamafarm

    Launch

    Deploy any AI model and related databases, RAG, agents, and pipelines to any device in 30 seconds. No cloud required.

    Free

  6. R

    Routerly.ai

    Launch

    Self-hosted LLM gateway that routes requests across AI providers (OpenAI, Anthropic, Gemini, Mistral, Ollama) using intelligent multi-policy scoring — including an LLM-native routing policy. Drop-in compatible: just swap the base URL. No da

    FreeSelf-hosted

More like Baseten

7
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
8
W

Willow Inference Server

Open source, local, and self-hosted highly optimized language inference…

Launch
9
X

Xybrid

Cross-platform on-device AI toolkit

Launch
10
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
11
D

Dify Google Cloud Terraform

Terraform configuration for deploying Dify on Google Cloud

Launch
12
M

Manifest

A complete backend in a single YAML file

Launch
13
A

Alien

Infrastructure for managed self-hosting

Launch
14
C

Cloudflare AI Web

Cloudflare AI Platform with one-click deployment

Launch
15
A

Aikit

Fine-tune, build, and deploy open-source LLMs easily!

Launch
16
O

Open WebUI

Run AI on your own terms

Launch
17
L

Latitude

AI Agent Observability & Monitoring

Launch
18
H

Horay.ai

Unlock your AI Creativity with Horay.ai’s Blazing Fast

Launch
19
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
20
D

Deepset

Automate data processing, leverage AI for insights and connections

Launch
21
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
22
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
23
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
24
B

Beam

Run GPU inference, task queues, and sandboxes on serverless infrastructure

Launch
25
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
26
R

Replicate

Machine learning doesn’t need to be so hard

Launch
27
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
28
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
29
Z

Zenml

One AI Platform from Pipelines to Agents. https://zenml.io

Launch
30
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
31
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
32
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
33
C

Cloud ML Engine

Train custom models, leverage pre-trained models

Launch
34
Z

Zetaforgedev

Open source AI platform for rapid development of advanced AI and AGI pipelines

Launch
35
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
36
D

Dify

Open-source LLM app development platform

Launch
37
L

LLM Gateway

Route, manage, and analyze LLM requests across multiple providers with one API

Launch
38
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
39
B

BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Launch
40
1

1backend

Build AI (or any) apps with scalable microservices & microfrontends

Launch
41
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
42
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
43
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
44
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
45
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

Launch
46
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
47
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
48
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
49
O

Obot AI

Complete AI Governance Platform from Obot AI

Launch
50
Q

Qwen3.6-windows-server

One-click Qwen3.6-27B inference on Windows

Launch

About Baseten

B

Baseten

Inference Platform: Deploy AI models in production

Baseten is an inference platform for serving and scaling open-source, custom and fine-tuned AI models in production. You can deploy models on dedicated infrastructure for high-scale workloads, or use pre-optimised Model APIs to try models such as GLM, DeepSeek and Kimi without setting up infrastructure. The platform includes fast cold starts, autoscaling, cross-cloud high availability and runtimes for image generation, transcription, text-to-speech, LLMs and embeddings. Training is available with the Loops SDK, and the same stack can serve the trained models. Deployment can run in Baseten's cloud, in your own VPC, or in a hybrid setup. The Basic plan is $0 a month with pay-as-you-go pricing, and includes dedicated deployments, Model APIs and training, with SOC 2 Type II and HIPAA compliance. Pro adds priority GPU access and dedicated support, and Enterprise adds custom SLAs, self-hosted deployments and data residency controls, priced by quote.

Price
Freemium
Category
AI
Website
baseten.co