200 apps like vLLM, closest match first.
Ollama Grid Search
A multi-platform desktop application to evaluate and compare LLM models
huawei-cloud-openviking-embedding-switch
Switch OpenViking's embedding model to a local llama-server
overtchat
A simpler self-hosted alternative to Open WebUI
Camelid
A Rust-native local inference backend
Matrixhub
An Open-source, self-hosted AI model hub
Ava
All-in-one desktop app for running LLMs locally
Llmtrim
Local proxy that compresses your LLM API requests so you pay less
Audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml
Vellum
Vellum helps developers build AI systems
Corpusos
Open-source protocol suite standardizing LLM, Vector, Graph
Keras LLM Robot
A web UI Project In order to learn the large language model
Open WebUI
Run AI on your own terms
Memlayer
Plug-and-play memory for LLMs in 3 lines of code
Gerbil
A desktop app for running Large Language Models locally
LLamaTuner
Easy and Efficient Finetuning LLMs
Portkey
Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps
dialagram
Unlimited LLM API access through an OpenAI-compatible router
Pulsar
SSD-streaming inference engine for giant MoE models (Rust + CUDA)
ObsidianArc
A self-hosted AI platform with a Go server, multi-provider routing, usage…
Minimal LLM UI
Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…
LLM Axe
A simple, intuitive toolkit for quickly implementing LLM powered applications
Rig
Build modular and scalable LLM Applications in Rust
Xybrid
Cross-platform on-device AI toolkit
cost-aware-llm-pipeline
Cost optimization patterns for LLM API usage
Llmflows
Simple, Explicit and Transparent LLM Apps
Deep Infra
DeepInfra offers cost-effective, scalable, easy-to-deploy
jetson-package
Pick Jetson-compatible containers, vLLM runtime images
Llocal
Aiming to provide a seamless and privacy driven chatting experience
Nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
AlphaNeuralAI
Call any AI model through one OpenAI-compatible API at the price on its page
Otari
Open-source, OpenAI-compatible LLM gateway you run yourself
ETOS-LLM-Studio
A native LLM client for iOS & Apple Watch
Inferly
LLM telemetry without touching prompt content
huggingface-best
About finding the best, top, or recommended model for a task
OrcaRouter-Lite
Self-hosted LLM router with a managed safety net
Inference.net
Deploy and manage AI models
vMLX
Run local AI models on Apple Silicon
mlx-dspark
Up to 4× faster LLM decoding on Apple Silicon, lossless
OllaMan
Powerful Ollama AI Model Manager
OfflineLLM
Private on-device AI chat for Android
OfoxAI
One API key for 100+ LLMs. OpenAI-compatible
LLM API
Free LLM API: 100+ models, one single interface, and smart cost-aware analytics
Aikit
Fine-tune, build, and deploy open-source LLMs easily!
Embedbase
A dead-simple API to build LLM-powered apps
Dialog
RAG LLM Ops App for easy deployment and testing
transformers
Hugging Face Transformers for loading Hub models, running pipeline inference
Envyon AI
Deploy powerful AI models on private, dedicated infrastructure
AndroLLM
Open-source Android AI using LiteRT-LM
Efficient-LLMs-Survey
[TMLR 2024] Efficient Large Language Models: A Survey
Lambda
Deploy GPU clusters swiftly; extensive AI model training support