Skip to content
llama.cpp

Free alternatives to llama.cpp

200 free apps like llama.cpp, closest match first.

More like llama.cpp

51
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
52
C

Chipper

AI interface for tinkerers (Ollama, Haystack RAG, Python)

Launch
53
W

Whisper.cpp

Port of OpenAI's Whisper model in C/C++

Launch
54
G

Graviton

500B+ LLMs on a Mac Mini

Launch
55
L

llmfit-hardware-model-matcher

Terminal tool that detects your hardware and recommends

Get
56
H

Hax

A minimalist, terminal-native coding agent written in C

Launch
57
K

Keras LLM Robot

A web UI Project In order to learn the large language model

Launch
58
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
59
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
60
G

Gerbil

A desktop app for running Large Language Models locally

Launch
61
M

Manifest

A complete backend in a single YAML file

Launch
62
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
63
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
64
G

GoModel

AI gateway written in Go with a unified OpenAI-compatible API

Launch
65
S

Slotstream

Run a 105 GB AI model on a Mac that can't hold it

Launch
66
B

Bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Launch
67
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
68
M

MTPLX

The fastest way to run Qwen 3.8 Flash Next

Launch
69
S

Self-Hosted AI Stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Launch
70
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
71
C

Coreai Model Zoo

Downloadable models and conversion recipes for Apple's Core AI on iPhone and Mac

Launch
72
T

Textgen

Open-source desktop app for local LLMs

Launch
73
P

Portable-Local-Studio

Portable local AI studio for Windows, Linux, and macOS

Launch
74
C

Claude Code Local

Run Claude Code 100% on-device with local AI on Apple Silicon

Launch
75
O

Onnx Web

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion

Launch
76
P

PyGPT

Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Grok, Ollama

Launch
77
N

nemo-mbridge-recipe-recommender

Recommend and customize Megatron Bridge library and benchmark recipes

Get
78
N

nemo-mbridge-perf-cpu-offloading

Validate and use CPU offloading in Megatron Bridge

Get
79
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
80
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
81
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
82
L

llama.ui

A minimal interface for AI Companion that runs entirely in your browser

Launch
83
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
84
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
85
R

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM…

Launch
86
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
87
A

Anubis Oss

Local LLM Testing & Benchmarking for Apple Silicon

Launch
88
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
89
T

Tenere

TUI for LLMs

Launch
90
L

Llamafile

Distribute and run LLMs with a single file

Launch
91
O

Openclaw.net

Self-hosted Enterprise and Personal AI + agent runtime in .NET

Launch
92
G

GPT Mobile

Chat app for Android that supports answers from multiple LLMs at once

Launch
93
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
94
A

Alpaca

Local and online AI hub

Launch
95
D

Daan

Lightweight LLM Client with MCP & Characters

Launch
96
N

Nesa

Run AI models end-to-end encrypted

Launch
97
A

apple-on-device-ai

Build private, on-device AI features on iPhone, iPad, and Mac

Get
98
M

Msty

Use Llama 3, GPT-4o, Mixtral, Gemma, etc. on your computer. Ultimate privacy

Launch
99
H

huggingface-best

About finding the best, top, or recommended model for a task

Get
100
C

Corpusos

Open-source protocol suite standardizing LLM, Vector, Graph

Launch