200 apps like llama.cpp, closest match first.
Routerly.ai
Self-hosted LLM gateway that routes requests across AI providers
Llmtrim
Local proxy that compresses your LLM API requests so you pay less
Magnitude
Run open models as fast as your hardware allows
Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM…
Cherry Studio
A desktop client that supports multiple large language model (LLM) providers
Anubis Oss
Local LLM Testing & Benchmarking for Apple Silicon
Baidu PaddlePaddle
Develop adaptive AI solutions effortlessly, leverage GPU acceleration
Llocal
Aiming to provide a seamless and privacy driven chatting experience
Tenere
TUI for LLMs
Llamafile
Distribute and run LLMs with a single file
Openclaw.net
Self-hosted Enterprise and Personal AI + agent runtime in .NET
GPT Mobile
Chat app for Android that supports answers from multiple LLMs at once
Devo
Model-neutral agent desktop/runtime for private, enterprise
Alpaca
Local and online AI hub
Qiskit Gym MCP Server
A collection of MCP servers to allow LLMs
Daan
Lightweight LLM Client with MCP & Characters
Nesa
Run AI models end-to-end encrypted
apple-on-device-ai
Build private, on-device AI features on iPhone, iPad, and Mac
Msty
Use Llama 3, GPT-4o, Mixtral, Gemma, etc. on your computer. Ultimate privacy
EmpirioLabs AI
Low-cost AI Infrastructure Platform
Qiskit IBM Transpiler MCP Server
huggingface-best
About finding the best, top, or recommended model for a task
Corpusos
Open-source protocol suite standardizing LLM, Vector, Graph
NadirClaw
Source-available LLM router and AI cost optimizer
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
Nacho Flow
Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)
freellmpool
Free LLM gateway: 22 LLM providers, 178 enabled chat routes
GoModel
AI gateway / AI control plane / AI proxy written in Go
Swarm
Type-safe tools, on-device inference, multi-agent workflows, memory
overtchat
A simpler self-hosted alternative to Open WebUI
Embedbase
A dead-simple API to build LLM-powered apps
Chorus
Chat with multiple AI models on Mac
Matrixhub
An Open-source, self-hosted AI model hub
MagicWX
Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for…
ToolNeuron
Encrypted & Privacy First, On Android Device AI App
Deltafin
Run full Kimi K3 on a single device
Promptulate
Lightweight Large language model automation
YoloRouter
A self-hosted, OpenAI-compatible LLM gateway
AlphaNeuralAI
Call any AI model through one OpenAI-compatible API at the price on its page
jetson-inference-mem-tune
Pick the serving stack and per-runtime memory flags
Fastllm-proxy
The lowest-overhead LLM router
Mirai
Inference engine for AI models
AI LLM Comparison
A website where you can compare every AI Model
Private AI Chat
Local In-Browser LLM Inference
dialagram
Unlimited LLM API access through an OpenAI-compatible router
SourceWeft
Open-source, self-hostable alternative to ChatGPT and NotebookLM
OpenAgentCore
Open-source, self-hosted implementation of the OpenAI Agents API
Parakeet
OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX)
Auriko
One API to easily switch LLM models, reduce inference cost, and stay reliable
Minimal LLM UI
Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…