Skip to content
vLLM

Open source alternatives to vLLM

200 open source apps like vLLM, closest match first.

More like vLLM

151
H

Horay.ai

Unlock your AI Creativity with Horay.ai’s Blazing Fast

Launch
152
G

GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index

Launch
153
B

Beam

Run GPU inference, task queues, and sandboxes on serverless infrastructure

Launch
154
O

ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3

Launch
155
H

HilbertRaum

AI, fully local on your computer

Launch
156
V

VLMEvalKit

Open-source evaluation toolkit of large multi-modality models

Launch
157
O

OpenLIT: Zero code Agent Observability

Continuous feedback for testing, tracing & fixing AI agents

Launch
158
W

Whisper.cpp

Port of OpenAI's Whisper model in C/C++

Launch
159
M

Minimind V

Train a 65M-parameter VLM from scratch in just 2h!

Launch
160
L

LLaMA-Omni

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction…

Launch
161
A

Artifex

Small Language Model Inference, Fine-Tuning and Observability

Launch
162
O

Openagent

next-generation personal AI assistant powered by LLM, RAG and agent loops

Launch
163
M

Mnemo

Local-first AI memory layer for any LLM

Launch
164
B

Backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more

Launch
165
G

GPT4All

GPT4All runs open-source language models locally on Windows, macOS

Launch
166
G

Genie-TTS

GPT-SoVITS ONNX Inference Engine & Model Converter

Launch
167
O

Omarchy Local AI

Local AI for Omarchy: the model validated for your GPU, one button on the bar

Launch
168
E

EchoLLM

The latest and greatest AI models, all in one place

Launch
169
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
170
H

Helix

Private Agent Fleet with Spec Coding

Launch
171
S

Shodh Memory

Local, LLM-free memory for AI agents

Launch
172
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
173
F

Free-GPT4-WEB-API

Not just GPT4! Easy to use, Self-Hosted

Launch
174
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
175
S

Swarm

Type-safe tools, on-device inference, multi-agent workflows, memory

Launch
176
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
177
P

Parakeet

OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX)

Launch
178
O

Onnx Web

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion

Launch
179
M

MoE4All

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs

Launch
180
C

Chipper

AI interface for tinkerers (Ollama, Haystack RAG, Python)

Launch
181
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
182
T

ToolNeuron

Encrypted & Privacy First, On Android Device AI App

Launch
183
L

Langkit

An open-source toolkit for monitoring Large Language Models (LLMs)

Launch
184
D

Daan

Lightweight LLM Client with MCP & Characters

Launch
185
R

Rag.computer

Self-hostable RAG platform - document ingestion, embedding, and vector search…

Launch
186
L

LLM God

Desktop app to multi-prompt ChatGPT, Gemini and more at the same time!

Launch
187
R

RunAnywhere

Fastest inference anywhere: open models on-prem, hosted or on-device

Launch
188
A

API7 cloud

Deploy and manage projects effortlessly

Launch
189
P

Private LLM - Local AI Chat

Discover the Ultimate Privacy-Focused AI Assistant on iOS: Private LLM

Launch
190
N

Nllb Serve

Meta's "No Language Left Behind" models served as web app and REST API

Launch
191
M

MTPLX

The fastest way to run Qwen 3.8 Flash Next

Launch
192
L

Lemonade Server

Refreshingly fast LLMs on GPUs and NPUs

Launch
193
B

Bhatti

Self-Hostable MicroVMs for your Agents

Launch
194
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
195
V

vMetal

Bare Metal & VM Provisioning for GPU Clouds

Launch
196
S

shoehorn

Make any language model fit your machine

Launch
197
N

Notebookllama

A fully open-source, LlamaCloud-backed alternative to NotebookLM

Launch
198
H

huggingface/hugging-face-jobs

Run compute jobs and Python scripts on HF infrastructure

Get
199
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
200
V

voltagent/create-voltagent

Project setup guide with CLI and manual steps

Get