200 free apps like vLLM, closest match first.
Pulsar
SSD-streaming inference engine for giant MoE models (Rust + CUDA)
ObsidianArc
A self-hosted AI platform with a Go server, multi-provider routing, usage…
Minimal LLM UI
Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…
LLM Axe
A simple, intuitive toolkit for quickly implementing LLM powered applications
Rig
Build modular and scalable LLM Applications in Rust
Xybrid
Cross-platform on-device AI toolkit
cost-aware-llm-pipeline
Cost optimization patterns for LLM API usage
Llmflows
Simple, Explicit and Transparent LLM Apps
jetson-package
Pick Jetson-compatible containers, vLLM runtime images
Llocal
Aiming to provide a seamless and privacy driven chatting experience
Nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
Otari
Open-source, OpenAI-compatible LLM gateway you run yourself
ETOS-LLM-Studio
A native LLM client for iOS & Apple Watch
huggingface-best
About finding the best, top, or recommended model for a task
OrcaRouter-Lite
Self-hosted LLM router with a managed safety net
vMLX
Run local AI models on Apple Silicon
mlx-dspark
Up to 4× faster LLM decoding on Apple Silicon, lossless
OfflineLLM
Private on-device AI chat for Android
LLM API
Free LLM API: 100+ models, one single interface, and smart cost-aware analytics
Coai
Next Gen Multi-tenant AI One-Stop Solution
Aikit
Fine-tune, build, and deploy open-source LLMs easily!
Embedbase
A dead-simple API to build LLM-powered apps
Dialog
RAG LLM Ops App for easy deployment and testing
transformers
Hugging Face Transformers for loading Hub models, running pipeline inference
AndroLLM
Open-source Android AI using LiteRT-LM
Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
Nativ
Local AI, native to your Mac
Uncensored-Local-AI-Multiplatform
A cross-platform Flutter app that runs uncensored, 100% offline open-source…
Oriveo
Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…
Octopus
One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
Unsloth
Local UI to run and train LLMs and diffusion models
Slotstream
Run a 105 GB AI model on a Mac that can't hold it
Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models…
ai-engineer
Build production-ready LLM applications, advanced RAG systems
Agentsystems
Self-hosted app store and runtime for AI agents
Envoy AI Gateway
Open source gateway built on Envoy
neon-ai-gateway
One API and one credential for frontier and open-source LLMs
Sage
Self-hosted voice chat with LLMs
Cherry Studio
A desktop client that supports multiple large language model (LLM) providers
FreeLingo
Open-source, self-hosted AI language learning platform
Faster Whisper
Faster Whisper transcription with CTranslate2
Scikit LLM
Seamlessly integrate LLMs into scikit-learn
Vall E
PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech)
Devo
Model-neutral agent desktop/runtime for private, enterprise
Selfhost AI
One-command installer for a self-hosted AI stack on your own server: n8n
tao-finetune-huggingface-model
Fine-tune any HuggingFace CV / VLM / LLM model on local NVIDIA GPUs inside an
huggingface-llm-trainer
Train or fine-tune language and vision models using TRL
Inferock Bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini
NadirClaw
Source-available LLM router and AI cost optimizer
Belullama
Belullama is a comprehensive AI application