Skip to content
vLLM

Alternatives to vLLM

200 apps like vLLM, closest match first.

More like vLLM

51
O

Osaurus

LLM server built on MLX

Launch
52
P

Project Maya

Run GLM-5.3-Flash (321B MoE) privately on your own GPU(s)…

Launch
53
M

MLX Tune

Fine-tune LLMs on your Mac with Apple Silicon

Launch
54
L

Lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Launch
55
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
56
G

Graviton

500B+ LLMs on a Mac Mini

Launch
57
C

CanIRun.ai

Check AI model hardware compatibility

Launch
58
B

Baseten

Inference Platform: Deploy AI models in production

Launch
59
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
60
Q

Qwen3.6-windows-server

One-click Qwen3.6-27B inference on Windows

Launch
61
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
62
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
63
M

Manifest

A complete backend in a single YAML file

Launch
64
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
65
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
66
K

Kalavai Client

Aggregates compute from spare GPU capacity

Launch
67
L

LocalAI

Unlock the power of AI with LocalAI, the ultimate AI model management tool

Launch
68
L

Locai

AI orchestration for open-weight models and frontier APIs

Launch
69
T

TRAE-Ollama-Bridge

Encapsulate the local Ollama into an OpenAI-compatible API

Launch
70
N

Nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and…

Launch
71
L

LLM Harbor

Containerized LLM toolkit

Launch
72
L

Local Studio

Control panel for VLLM, Sglang, llama.cpp, exllamav3

Launch
73
M

Magnitude

Run open models as fast as your hardware allows

Launch
74
A

Anubis Oss

Local LLM Testing & Benchmarking for Apple Silicon

Launch
75
S

Sipp

AI inference, packed simply

Launch
76
T

TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models

Launch
77
L

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models

Launch
78
M

MLX-LoRA-Studio

A native Mac App for LLM fine-tuning on Apple Silicon

Launch
79
R

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM…

Launch
80
W

WebLLM Chat

Chat with AI large language models running natively in your browser

Launch
81
T

Transformer Lab

100% Open Source Toolkit for Large Language Models: Train, Tune

Launch
82
L

Ling

The LLMs' framework optimized for ultra-fast response times

Launch
83
Q

Quail

Local model server for GGUF and MLX models on Apple silicon

Launch
84
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
85
L

LLM LS

LSP server leveraging LLMs for code completion (and more?)

Launch
86
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
87
N

Nativ

Run AI models locally

Launch
88
R

Reins

Local AI chat for iPhone, iPad and Mac

Launch
89
I

Inferencer

Run and Deeply Control Local AI Models

Launch
90
O

One API

LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google

Launch
91
R

ROLV

20× faster AI inference. 81.5% less energy. No new hardware

Launch
92
S

Strix Halo Llamacpp

Performance-tuned llama.cpp for AMD Strix Halo

Launch
93
F

Fireworks AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed

Launch
94
L

Lollms Hub

A proxy server for multiple ollama instances with Key security

Launch
95
D

Deepseek-ocr.rs

Rust multi‑backend OCR/VLM engine (DeepSeek‑OCR-1/2, PaddleOCR‑VL, DotsOCR)…

Launch
96
L

Llamafarm

Deploy any AI model, agent, database, RAG

Launch
97
A

Auriko

One API to easily switch LLM models, reduce inference cost, and stay reliable

Launch
98
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
99
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
100
J

Janas

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs…

Launch