Alternatives to llama.cpp
200 apps like llama.cpp, closest match first.
Top picks
- W
whatcani.run
Launchwhatcani.run helps you find the best AI models to run locally and how to run them, based on real data from trials that people ran on their own hardware. Each model is listed with its runtime, decode and prefill speed, time to first token, p
Free
- M

mlx-serve
LaunchNative Zig inference server for Apple Silicon. Runs any LLM — MLX and GGUF — faster than LM Studio. OpenAI- and Anthropic-compatible (Claude Code) APIs. No Python. Drop-in alternative to LM Studio, Ollama, and llama.cpp on macOS. Gemma 4, Q
Free
- T

TurboLLM
LaunchRun open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA
FreeSelf-hosted
- L

LLMKube
LaunchLLMKube is a Kubernetes operator for running language models on your own hardware. You write a Model resource and an InferenceService resource in YAML, and the operator serves the model behind an OpenAI-compatible endpoint once it is ready.
FreeSelf-hosted
- Q

Quail
LaunchLocal model server for GGUF and MLX models on Apple silicon, with OpenAI- and Anthropic-compatible APIs for tools like Claude Code and Codex. [![Open-Source Software][OSS Icon]](https://github.com/adatoo/quail) ![Freeware][Freeware Icon] 
vllm-mlx
Launchvllm-mlx is an inference server for large language models on Apple Silicon. It exposes OpenAI-compatible and Anthropic-compatible APIs, so existing clients and tools can talk to a model running on your Mac. The engine is built on MLX, Apple
Free
More like llama.cpp
Willow Inference Server
Open source, local, and self-hosted highly optimized language inference…
Uncensored-Local-AI-Multiplatform
A cross-platform Flutter app that runs uncensored, 100% offline open-source…
Local Llms On Android
Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private
Locally AI by LM Studio
Run AI models like Llama, Gemma, Qwen, and more on your iPhone and iPad
About llama.cpp
llama.cpp
C/C++ inference engine for large language models, supporting quantization
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
- Category
- AI
- Website
- llama.app


