Skip to content
vLLM

Free alternatives to vLLM

200 free apps like vLLM, closest match first.

More like vLLM

101
P

Pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA)

Launch
102
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
103
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch
104
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
105
R

Rig

Build modular and scalable LLM Applications in Rust

Launch
106
X

Xybrid

Cross-platform on-device AI toolkit

Launch
107
C

cost-aware-llm-pipeline

Cost optimization patterns for LLM API usage

Get
108
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
109
J

jetson-package

Pick Jetson-compatible containers, vLLM runtime images

Get
110
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
111
N

Nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

Launch
112
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
113
E

ETOS-LLM-Studio

A native LLM client for iOS & Apple Watch

Launch
114
H

huggingface-best

About finding the best, top, or recommended model for a task

Get
115
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
116
V

vMLX

Run local AI models on Apple Silicon

Launch
117
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
118
O

OfflineLLM

Private on-device AI chat for Android

Launch
119
L

LLM API

Free LLM API: 100+ models, one single interface, and smart cost-aware analytics

Launch
120
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
121
A

Aikit

Fine-tune, build, and deploy open-source LLMs easily!

Launch
122
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
123
D

Dialog

RAG LLM Ops App for easy deployment and testing

Launch
124
T

transformers

Hugging Face Transformers for loading Hub models, running pipeline inference

Get
125
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
126
E

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

Launch
127
N

Nativ

Local AI, native to your Mac

Launch
128
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
129
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
130
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
131
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
132
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
133
P

Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models…

Launch
134
A

ai-engineer

Build production-ready LLM applications, advanced RAG systems

Get
135
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
136
E

Envoy AI Gateway

Open source gateway built on Envoy

Launch
137
N

neon-ai-gateway

One API and one credential for frontier and open-source LLMs

Get
138
S

Sage

Self-hosted voice chat with LLMs

Launch
139
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
140
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
141
F

Faster Whisper

Faster Whisper transcription with CTranslate2

Launch
142
S

Scikit LLM

Seamlessly integrate LLMs into scikit-learn

Launch
143
V

Vall E

PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech)

Launch
144
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
145
S

Selfhost AI

One-command installer for a self-hosted AI stack on your own server: n8n

Launch
146
T

tao-finetune-huggingface-model

Fine-tune any HuggingFace CV / VLM / LLM model on local NVIDIA GPUs inside an

Get
147
H

huggingface-llm-trainer

Train or fine-tune language and vision models using TRL

Get
148
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
149
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
150
B

Belullama

Belullama is a comprehensive AI application

Launch