Paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs
by intenteeFree
Description
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.…
Information
Ratings & Reviews
No ratings yet
Be the first to rate Paddler.
People also visit
Paddler FAQ
What is Paddler?
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Is Paddler free?
Yes. Paddler is free to use.
Do I need to download Paddler?
No. Paddler runs in your browser at paddler.intentee.com, so there's nothing to install.
Who makes Paddler?
Paddler is made by intentee.
What are the best Paddler alternatives?
Popular alternatives to Paddler include Open WebUI, Ollama and Langfuse. See all Paddler alternatives