Free alternatives to vLLM
200 free apps like vLLM, closest match first.
More like vLLM

zeroboot-vm-sandbox
Sub-millisecond VM sandboxes for AI agents using copy-on-write KVM forking
Omarchy Local AI
Local AI for Omarchy: the model validated for your GPU, one button on the bar
Comfyui Triton And Sageattention Installer
Cross-platform installer for Triton and SageAttention on ComfyUI

nemo-mbridge-recipe-recommender
Recommend and customize Megatron Bridge library and benchmark recipes

huggingface-zerogpu
AI demos and GPU compute with Gradio Spaces and Hugging Face Spaces ZeroGPU

nemo-mbridge-perf-sequence-packing
Validate and use packed sequences and long-context training in Megatron-Bridge

physical-ai-infrastructure-setup-and-resilient-scaling
Set up, scale, validate, or harden NVIDIA physical AI infrastructure

nemo-mbridge-perf-moe-hardware-configs
Representative, point-in-time MoE training playbooks by hardware

nemo-mbridge-perf-activation-recompute
Validate and use selective and full activation recompute in Megatron Bridge

tilegym-monkey-patch-kernels-to-transformers
Integrate TileGym kernels into Hugging Face `transformers` models











