Skip to content
llama.cpp

Open source alternatives to llama.cpp

200 open source apps like llama.cpp, closest match first.

More like llama.cpp

51
G

Graviton

500B+ LLMs on a Mac Mini

Launch
52
H

Hax

A minimalist, terminal-native coding agent written in C

Launch
53
K

Keras LLM Robot

A web UI Project In order to learn the large language model

Launch
54
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
55
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
56
G

Gerbil

A desktop app for running Large Language Models locally

Launch
57
M

Manifest

A complete backend in a single YAML file

Launch
58
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
59
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
60
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
61
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
62
B

Bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Launch
63
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
64
M

MTPLX

The fastest way to run Qwen 3.8 Flash Next

Launch
65
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
66
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
67
C

Coreai Model Zoo

Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac

Launch
68
T

Textgen

Open-source desktop app for local LLMs

Launch
69
P

Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS

Launch
70
C

Claude Code Local

Run Claude Code 100% on-device with local AI on Apple Silicon

Launch
71
O

Onnx Web

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion

Launch
72
P

PyGPT

Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Grok, Ollama

Launch
73
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
74
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
75
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
76
L

llama.ui

A minimal interface for AI Companion that runs entirely in your browser

Launch
77
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
78
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
79
M

Magnitude

Run open models as fast as your hardware allows

Launch
80
R

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM…

Launch
81
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
82
A

Anubis Oss

Local LLM Testing & Benchmarking for Apple Silicon

Launch
83
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
84
T

Tenere

TUI for LLMs

Launch
85
L

Llamafile

Distribute and run LLMs with a single file

Launch
86
O

Openclaw.net

Self-hosted Enterprise and Personal AI + agent runtime in .NET

Launch
87
G

GPT Mobile

Chat app for Android that supports answers from multiple LLMs at once

Launch
88
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
89
A

Alpaca

Local and online AI hub

Launch
90
D

Daan

Lightweight LLM Client with MCP & Characters

Launch
91
N

Nesa

Run AI models end-to-end encrypted

Launch
92
C

Corpusos

Open-source protocol suite standardizing LLM, Vector, Graph

Launch
93
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
94
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
95
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
96
S

Swarm

Type-safe tools, on-device inference, multi-agent workflows, memory

Launch
97
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
98
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
99
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
100
M

MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for…

Launch