Skip to content
vLLM

Open source alternatives to vLLM

200 open source apps like vLLM, closest match first.

More like vLLM

101
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch
102
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
103
R

Rig

Build modular and scalable LLM Applications in Rust

Launch
104
X

Xybrid

Cross-platform on-device AI toolkit

Launch
105
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
106
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
107
N

Nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

Launch
108
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
109
E

ETOS-LLM-Studio

A native LLM client for iOS & Apple Watch

Launch
110
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
111
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
112
O

OfflineLLM

Private on-device AI chat for Android

Launch
113
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
114
A

Aikit

Fine-tune, build, and deploy open-source LLMs easily!

Launch
115
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
116
D

Dialog

RAG LLM Ops App for easy deployment and testing

Launch
117
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
118
E

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

Launch
119
N

Nativ

Local AI, native to your Mac

Launch
120
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
121
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
122
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
123
A

AnythingLLM

A desktop and self-hostable AI app for chatting

Launch
124
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
125
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
126
P

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models…

Launch
127
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
128
E

Envoy AI Gateway

Open source gateway built on Envoy

Launch
129
F

Falcon LLM

Multilingual, multimodal, scalable AI tool; open-source

Launch
130
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
131
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
132
F

Faster Whisper

Faster Whisper transcription with CTranslate2

Launch
133
S

Scikit LLM

Seamlessly integrate LLMs into scikit-learn

Launch
134
V

Vall E

PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech)

Launch
135
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
136
S

Selfhost AI

One-command installer for a self-hosted AI stack on your own server: n8n

Launch
137
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
138
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
139
B

Belullama

Belullama is a comprehensive AI application

Launch
140
L

Langflow

Build, deploy, and iterate on AI agents, RAG applications, and MCP servers

Launch
141
O

OpenLive

Opensource, on-device voice + vision layer for AI agents

Launch
142
P

Pezzo

Open-source, developer-first LLMOps platform

Launch
143
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
144
R

RP Engine

YAML-native agent workflow execution engine, written in Rust

Launch
145
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
146
L

Little Coder

A harness optimized to smaller LLMs

Launch
147
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
148
R

RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB

Launch
149
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
150
O

OpenComputer

Provides always-on virtual machines for AI agents

Launch