Self-hosted alternatives to Gestell
200 self-hosted apps like Gestell, closest match first.
Top picks
- L
Llmaker
LaunchModels, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
FreeOpen sourceSelf-hosted
- O
OpenGateLLM
LaunchOpenGateLLM is an open-source API gateway for generative AI. It is built for organizations that want full control over their data and infrastructure, and it is optimized for self-hosted models. The gateway centralizes, secures and governs a
FreeOpen sourceSelf-hosted
- P
Paddler
LaunchOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem.
FreeOpen sourceSelf-hosted
- L

LLMKube
LaunchLLMKube is a Kubernetes operator for running language models on your own hardware. You write a Model resource and an InferenceService resource in YAML, and the operator serves the model behind an OpenAI-compatible endpoint once it is ready.
FreeSelf-hosted
- T
The OSS LLMOps Stack
LaunchModular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance eval
FreeOpen sourceSelf-hosted
- D
Duragraph
LaunchSelf-hosted, enterprise-ready AI workflow orchestration with event sourcing, CQRS, fault tolerance, and observability. Single-binary control plane, Python + Go SDKs, embedded Postgres + NATS for zero-config dev.
FreeOpen sourceSelf-hosted
More like Gestell
Self-Hosted AI Stack
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Inference Gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM…
About Gestell

Gestell
Gestell studies PTX, SASS, compiler lowering, and GPU execution behavior
Gestell is an ETL for LLMs. We transform unstructured data into AI-ready databases through a process that spans from Enframing to Disclosure,...
- Price
- Paid
- Category
- AI
- Website
- gestell.ai