Skip to content
vLLM

Free alternatives to vLLM

200 free apps like vLLM, closest match first.

More like vLLM

151
O

OpenLive

Opensource, on-device voice + vision layer for AI agents

Launch
152
P

Pezzo

Open-source, developer-first LLMOps platform

Launch
153
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
154
R

RP Engine

YAML-native agent workflow execution engine, written in Rust

Launch
155
A

agent-platform-inference

Connects to and performs inference

Get
156
L

Little Coder

A harness optimized to smaller LLMs

Launch
157
A

Atomic-Chat

Local AI app and inference engine for agents

Launch
158
R

RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB

Launch
159
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
160
I

InferQuest

Become an Inference or Training Engineer

Launch
161
L

llmfit-hardware-model-matcher

Terminal tool that detects your hardware and recommends

Get
162
Z

zeroboot-vm-sandbox

Sub-millisecond VM sandboxes for AI agents using copy-on-write KVM forking

Get
163
H

HilbertRaum

AI, fully local on your computer

Launch
164
O

oracle

ONNX Runtime inference daemon for ML-enhanced plugin capabilities

Get
165
A

Artifex

Small Language Model Inference, Fine-Tuning and Observability

Launch
166
M

Mnemo

Local-first AI memory layer for any LLM

Launch
167
G

GPT4All

GPT4All runs open-source language models locally on Windows, macOS

Launch
168
O

Omarchy Local AI

Local AI for Omarchy: the model validated for your GPU, one button on the bar

Launch
169
E

EchoLLM

The latest and greatest AI models, all in one place

Launch
170
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
171
M

MakeHub.ai

Your LLM traffic, always on the fastest & cheapest route

Launch
172
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
173
O

observability-llm-obs

Answer questions about LLM and agentic-application behavior

Get
174
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
175
M

MoE4All

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs

Launch
176
L

Langkit

An open-source toolkit for monitoring Large Language Models (LLMs)

Launch
177
M

modal

Modal is a serverless cloud platform for running Python on demand

Get
178
M

Msty

Use Llama 3, GPT-4o, Mixtral, Gemma, etc. on your computer. Ultimate privacy

Launch
179
N

nemo-mbridge-perf-cpu-offloading

Validate and use CPU offloading in Megatron Bridge

Get
180
H

huggingface-community-evals

Run evaluations for Hugging Face Hub models

Get
181
N

nemo-mbridge-recipe-recommender

Recommend and customize Megatron Bridge library and benchmark recipes

Get
182
H

huggingface-zerogpu

AI demos and GPU compute with Gradio Spaces and Hugging Face Spaces ZeroGPU

Get
183
A

API7 cloud

Deploy and manage projects effortlessly

Launch
184
N

Nllb Serve

Meta's "No Language Left Behind" models served as web app and REST API

Launch
185
M

MTPLX

The fastest way to run Qwen 3.8 Flash Next

Launch
186
D

deep-learning-pytorch

Expert guidance for deep learning, transformers, diffusion models

Get
187
L

LLM Reference

Decision-support reference for engineers choosing an LLM and provider today

Launch
188
A

agent-tools

Run AI apps via inference.sh CLI

Get
189
F

fine-tuning-expert

Fine-tuning LLMs, training custom models

Get
190
N

nemo-mbridge-perf-sequence-packing

Validate and use packed sequences and long-context training in Megatron-Bridge

Get
191
P

physical-ai-infrastructure-setup-and-resilient-scaling

Set up, scale, validate, or harden NVIDIA physical AI infrastructure

Get
192
N

nemo-mbridge-perf-moe-hardware-configs

Representative, point-in-time MoE training playbooks by hardware

Get
193
N

nemo-mbridge-perf-activation-recompute

Validate and use selective and full activation recompute in Megatron Bridge

Get
194
T

tilegym-monkey-patch-kernels-to-transformers

Integrate TileGym kernels into Hugging Face `transformers` models

Get
195
B

Bhatti

Self-Hostable MicroVMs for your Agents

Launch
196
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
197
H

huggingface/hugging-face-jobs

Run compute jobs and Python scripts on HF infrastructure

Get
198
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
199
J

jetson-llm-benchmark

Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp

Get
200
H

huggingface/hugging-face-evaluation

Model evaluation with vLLM/lighteval and eval tables

Get