200 open source apps like vLLM, closest match first.
Minimal LLM UI
Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…
LLM Axe
A simple, intuitive toolkit for quickly implementing LLM powered applications
Rig
Build modular and scalable LLM Applications in Rust
Xybrid
Cross-platform on-device AI toolkit
Llmflows
Simple, Explicit and Transparent LLM Apps
Llocal
Aiming to provide a seamless and privacy driven chatting experience
Nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
Otari
Open-source, OpenAI-compatible LLM gateway you run yourself
ETOS-LLM-Studio
A native LLM client for iOS & Apple Watch
OrcaRouter-Lite
Self-hosted LLM router with a managed safety net
mlx-dspark
Up to 4× faster LLM decoding on Apple Silicon, lossless
OfflineLLM
Private on-device AI chat for Android
Coai
Next Gen Multi-tenant AI One-Stop Solution
Aikit
Fine-tune, build, and deploy open-source LLMs easily!
Embedbase
A dead-simple API to build LLM-powered apps
Dialog
RAG LLM Ops App for easy deployment and testing
AndroLLM
Open-source Android AI using LiteRT-LM
Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
Nativ
Local AI, native to your Mac
Uncensored-Local-AI-Multiplatform
A cross-platform Flutter app that runs uncensored, 100% offline open-source…
Oriveo
Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…
Octopus
One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
AnythingLLM
A desktop and self-hostable AI app for chatting
Unsloth
Local UI to run and train LLMs and diffusion models
Slotstream
Run a 105 GB AI model on a Mac that can't hold it
Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models…
Agentsystems
Self-hosted app store and runtime for AI agents
Envoy AI Gateway
Open source gateway built on Envoy
Falcon LLM
Multilingual, multimodal, scalable AI tool; open-source
Cherry Studio
A desktop client that supports multiple large language model (LLM) providers
FreeLingo
Open-source, self-hosted AI language learning platform
Faster Whisper
Faster Whisper transcription with CTranslate2
Scikit LLM
Seamlessly integrate LLMs into scikit-learn
Vall E
PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech)
Devo
Model-neutral agent desktop/runtime for private, enterprise
Selfhost AI
One-command installer for a self-hosted AI stack on your own server: n8n
Inferock Bench
Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini
NadirClaw
Source-available LLM router and AI cost optimizer
Belullama
Belullama is a comprehensive AI application
Langflow
Build, deploy, and iterate on AI agents, RAG applications, and MCP servers
OpenLive
Opensource, on-device voice + vision layer for AI agents
Pezzo
Open-source, developer-first LLMOps platform
Minion
A tiny single-file coding agent for self-hosted models
RP Engine
YAML-native agent workflow execution engine, written in Rust
Spanlens
Drop-in observability platform for OpenAI, Anthropic, and Gemini
Little Coder
A harness optimized to smaller LLMs
Atomic-Chat
Local AI app and inference engine for agents
RWKV-Runner
A RWKV management and startup tool, full automation, only 8MB
SourceWeft
Open-source, self-hostable alternative to ChatGPT and NotebookLM
OpenComputer
Provides always-on virtual machines for AI agents