Skip to content
vLLM

Alternatives to vLLM

200 apps like vLLM, closest match first.

More like vLLM

151
N

Nativ

Local AI, native to your Mac

Launch
152
E

EmpirioLabs AI

Low-cost AI Infrastructure Platform

Launch
153
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
154
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
155
G

Graphsignal

Inference Profiler

Launch
156
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
157
A

ai-engineer

Build production-ready LLM applications, advanced RAG systems

Get
158
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
159
F

Falcon LLM

Multilingual, multimodal, scalable AI tool; open-source

Launch
160
N

neon-ai-gateway

One API and one credential for frontier and open-source LLMs

Get
161
S

Sage

Self-hosted voice chat with LLMs

Launch
162
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
163
L

Locally AI by LM Studio

Run AI models like Llama, Gemma, Qwen, and more on your iPhone and iPad

Launch
164
S

Synexa AI

Simple, fast, and stable. Deploy AI models with just one line of code

Launch
165
O

oll.am

Pay once, use any AI model

Launch
166
T

tao-finetune-huggingface-model

Fine-tune any HuggingFace CV / VLM / LLM model on local NVIDIA GPUs inside an

Get
167
H

huggingface-llm-trainer

Train or fine-tune language and vision models using TRL

Get
168
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
169
B

Belullama

Belullama is a comprehensive AI application

Launch
170
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
171
A

agent-platform-inference

Connects to and performs inference

Get
172
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
173
I

Infrabase.ai

The AI infrastructure directory

Launch
174
F

freellmpool

Free LLM gateway: 22 LLM providers, 178 enabled chat routes

Get
175
G

GoModel

AI gateway / AI control plane / AI proxy written in Go

Get
176
I

InferQuest

Become an Inference or Training Engineer

Launch
177
L

llmfit-hardware-model-matcher

Terminal tool that detects your hardware and recommends

Get
178
Z

zeroboot-vm-sandbox

Sub-millisecond VM sandboxes for AI agents using copy-on-write KVM forking

Get
179
A

Alltegrio

The service supports AI evaluation for LLM applications, computer vision models

Launch
180
B

Beam

Run GPU inference, task queues, and sandboxes on serverless infrastructure

Launch
181
O

oracle

ONNX Runtime inference daemon for ML-enhanced plugin capabilities

Get
182
G

GPT4All

GPT4All runs open-source language models locally on Windows, macOS

Launch
183
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
184
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
185
O

observability-llm-obs

Answer questions about LLM and agentic-application behavior

Get
186
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
187
M

MoE4All

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs

Launch
188
L

Langkit

An open-source toolkit for monitoring Large Language Models (LLMs)

Launch
189
M

modal

Modal is a serverless cloud platform for running Python on demand

Get
190
N

nemo-mbridge-perf-cpu-offloading

Validate and use CPU offloading in Megatron Bridge

Get
191
H

huggingface-community-evals

Run evaluations for Hugging Face Hub models

Get
192
N

nemo-mbridge-recipe-recommender

Recommend and customize Megatron Bridge library and benchmark recipes

Get
193
H

huggingface-zerogpu

AI demos and GPU compute with Gradio Spaces and Hugging Face Spaces ZeroGPU

Get
194
A

API7 cloud

Deploy and manage projects effortlessly

Launch
195
N

Nllb Serve

Meta's "No Language Left Behind" models served as web app and REST API

Launch
196
L

LLM Reference

Decision-support reference for engineers choosing an LLM and provider today

Launch
197
N

NeutralLM

Discover, download, and run language models directly on your device

Launch
198
H

huggingface/hugging-face-jobs

Run compute jobs and Python scripts on HF infrastructure

Get
199
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
200
J

jetson-llm-benchmark

Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp

Get