LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes
by defilantechFree
Description
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API. (Source Code) Apache-2.0 Go/Docker/K8S…
Information
Ratings & Reviews
No ratings yet
Be the first to rate LLMKube.
People also visit
LLMKube FAQ
What is LLMKube?
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API. (Source Code) Apache-2.0 Go/Docker/K8S
Is LLMKube free?
Yes. LLMKube is free to use.
Do I need to download LLMKube?
No. LLMKube runs in your browser at llmkube.com, so there's nothing to install.
Who makes LLMKube?
LLMKube is made by defilantech.
What are the best LLMKube alternatives?
Popular alternatives to LLMKube include Open WebUI, Jan and Ollama. See all LLMKube alternatives