Skip to content
llama.cpp

Open source alternatives to llama.cpp

200 open source apps like llama.cpp, closest match first.

More like llama.cpp

151
T

Texts To Transformer

Train a tiny Transformer from scratch on your iMessage history

Launch
152
D

Deepseek Harness Desktop

Open-source Windows desktop client and GUI for DeepSeek Harness

Launch
153
C

CliRelay

Self-hosted AI gateway for coding CLIs

Launch
154
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
155
P

Pocketpaw

Your AI agent in 30 seconds

Launch
156
Q

Qwen3 TTS Apple Silicon

Run Qwen3-TTS text-to-speech locally on Mac (M1/M2/M3/M4)

Launch
157
G

Gemini-FastAPI

Web-based Gemini models wrapped into an OpenAI-compatible API

Launch
158
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
159
E

EdgeBox

A fully-featured, GUI-powered local LLM Agent sandbox

Launch
160
C

Chat0

Blazingly-fast open source AI chat app

Launch
161
S

Spanlens

Drop-in observability platform for OpenAI, Anthropic, and Gemini

Launch
162
B

BambooAI

An LLM-driven data analyst that works in a persistent Python kernel

Launch
163
C

ccLoad

Self-hosted AI API gateway for Claude Code

Launch
164
A

Albatross

Open source, terminal-first AI coding agent

Launch
165
S

Syrtis

AI token usage & quota monitor for the macOS menu bar

Launch
166
C

Codemap

a project brain for your AI

Launch
167
O

Ollama Gui

A Web Interface for chatting with your local LLMs via the ollama API

Launch
168
L

lpm

Start, stop, and duplicate dev projects with one click

Launch
169
L

LTEngine

Local AI Machine Translation. Powered by LLMs. LibreTranslate compatible

Launch
170
D

Dodaios

Your AI assistant, built for the agentic era

Launch
171
Y

Your-source-to-prompt.html

Quickly and securely turn your code projects into LLM prompts

Launch
172
A

Appl

A Prompt Programming Language. Seamlessly integrate LLMs with programs

Launch
173
G

GPT Anywhere

Use GPT anywhere with just one shortcut

Launch
174
A

AI Manager

AI Manager desktop application for AI coding tools

Launch
175
O

OpenLive

Opensource, on-device voice + vision layer for AI agents

Launch
176
M

Muxi

Deploy intelligence. Open-source infrastructure for AI agents in production

Launch
177
A

Ava

All-in-one desktop app for running LLMs locally

Launch
178
R

React Native Apple LLM

React Native Apple LLM plugin using Foundation Models

Launch
179
K

Keirouter

Your friendly, blazing-fast, self-hostable AI gateway

Launch
180
O

Openchatx MCP

Turn ChatGPT into a local agent runtime

Launch
181
A

Audio.cpp-webui

audio.cpp with a full-task WebUI - pure C++ audio-model inference engine…

Launch
182
S

Sherpa Onnx

Speech-to-text, text-to-speech, speaker diarization, speech enhancement

Launch
183
A

AI-Flow

Connect multiple AI models easily

Launch
184
C

CrispASR

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe

Launch
185
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
186
T

Transformer Lab

100% Open Source Toolkit for Large Language Models: Train, Tune

Launch
187
G

GPT4All

GPT4All runs open-source language models locally on Windows, macOS

Launch
188
K

Kronk

Go With Your Own Intelligence

Launch
189
T

ttommyth/interactive-mcp

Interactive LLM workflows

Get
190
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
191
L

Laya Coreml

Local Laya typed decisions on Apple Core ML and Neural Engine

Launch
192
A

API7 cloud

Deploy and manage projects effortlessly

Launch
193
F

Franken OCR

Pure-Rust, CPU-only OCR engine for Baidu Unlimited-OCR

Launch
194
L

Labml

Monitor deep learning model training and hardware usage from your mobile phone

Launch
195
K

Kolosal AI

A software for local training, downloading

Launch
196
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
197
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
198
I

Iris Android

IRIS is an android app for interfacing with GGUF / llama.cpp models locally

Launch
199
I

Icebreaker

A local AI chat app powered by Rust, iced, Hugging Face, and llama.cpp

Launch
200
S

Strix Halo Llamacpp

Performance-tuned llama.cpp for AMD Strix Halo

Launch