Skip to content
llama.cpp

Alternatives to llama.cpp

200 apps like llama.cpp, closest match first.

More like llama.cpp

51
A

AICanRun

Check which local AI models your phone can run and how fast

Launch
52
T

TRAE-Ollama-Bridge

Encapsulate the local Ollama into an OpenAI-compatible API

Launch
53
O

Olla

High-performance lightweight proxy and load balancer for LLM infrastructure

Launch
54
H

HilbertRaum

AI, fully local on your computer

Launch
55
O

ollama

Get up and running with large language models, locally

Launch
56
P

pooled

Peer-to-peer LLM inference in the browser: pool your devices

Launch
57
S

SMG

Engine-agnostic LLM gateway in Rust

Launch
58
L

Llamafarm

Deploy any AI model, agent, database, RAG

Launch
59
I

Inference Gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM…

Launch
60
P

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs

Launch
61
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
62
C

Chipper

AI interface for tinkerers (Ollama, Haystack RAG, Python)

Launch
63
W

Whisper.cpp

Port of OpenAI's Whisper model in C/C++

Launch
64
G

Graviton

500B+ LLMs on a Mac Mini

Launch
65
L

llmfit-hardware-model-matcher

Terminal tool that detects your hardware and recommends

Get
66
L

Locai

AI orchestration for open-weight models and frontier APIs

Launch
67
H

Hax

A minimalist, terminal-native coding agent written in C

Launch
68
K

Keras LLM Robot

A web UI Project In order to learn the large language model

Launch
69
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
70
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
71
G

Gerbil

A desktop app for running Large Language Models locally

Launch
72
B

Bonsai

A drop-in optimized inference build of Bonsai 1.7B for Apple Silicon

Launch
73
M

Manifest

A complete backend in a single YAML file

Launch
74
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
75
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
76
F

Fireworks AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed

Launch
77
F

FreeChat

Chat with AI language models on your Mac, totally offline

Launch
78
O

OllaMan

Powerful Ollama AI Model Manager

Launch
79
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
80
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
81
B

Bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Launch
82
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
83
L

Localmee

18 top open-source AI models, curated and tested for your device

Launch
84
M

MTPLX

The fastest way to run Qwen 3.8 Flash Next

Launch
85
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
86
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
87
C

Coreai Model Zoo

Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac

Launch
88
T

Textgen

Open-source desktop app for local LLMs

Launch
89
P

Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS

Launch
90
C

Claude Code Local

Run Claude Code 100% on-device with local AI on Apple Silicon

Launch
91
O

Onnx Web

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion

Launch
92
P

PyGPT

Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Grok, Ollama

Launch
93
N

nemo-mbridge-recipe-recommender

Recommend and customize Megatron Bridge library and benchmark recipes

Get
94
N

nemo-mbridge-perf-cpu-offloading

Validate and use CPU offloading in Megatron Bridge

Get
95
Q

Qiskit MCP Server

A collection of MCP servers to allow LLMs

Get
96
Q

Qiskit IBM Runtime MCP Server

A collection of MCP servers to allow LLMs

Get
97
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
98
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
99
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
100
L

llama.ui

A minimal interface for AI Companion that runs entirely in your browser

Launch