Skip to content
llama.cpp

Free alternatives to llama.cpp

200 free apps like llama.cpp, closest match first.

More like llama.cpp

101
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
102
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
103
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
104
S

Swarm

Type-safe tools, on-device inference, multi-agent workflows, memory

Launch
105
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
106
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
107
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
108
M

MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for…

Launch
109
L

Lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Launch
110
T

ToolNeuron

Encrypted & Privacy First, On Android Device AI App

Launch
111
D

Deltafin

Run full Kimi K3 on a single device

Launch
112
P

Promptulate

Lightweight Large language model automation

Launch
113
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
114
J

jetson-inference-mem-tune

Pick the serving stack and per-runtime memory flags

Get
115
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
116
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
117
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
118
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
119
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
120
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
121
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
122
P

Parakeet

OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX)

Launch
123
B

Backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more

Launch
124
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch
125
L

Ling

The LLMs' framework optimized for ultra-fast response times

Launch
126
L

LLM API

Free LLM API: 100+ models, one single interface, and smart cost-aware analytics

Launch
127
K

KokoroSharp

Fast local TTS inference engine in C# with ONNX runtime

Launch
128
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
129
K

Klee

A native macOS AI chat app powered by MLX

Launch
130
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
131
L

LMRing

Open-source, self-hostable LLM arena

Launch
132
L

Lnwjud

Local AI-agent runtime & MCP gateway

Launch
133
C

ChatGPT

A ChatGPT C# client for MacOS, Windows, Linux, Android, iOS and Browser

Launch
134
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
135
U

Unsaged

Open source chat kit engineered for seamless interaction with AI models

Launch
136
L

LTX Video Mac

Native macOS app for local AI video on Apple Silicon

Launch
137
C

Chaty

Private, local AI desktop app

Launch
138
D

Deepseek Harness Desktop

Compact DeepSeek Harness desktop host

Launch
139
O

Omarchy Local AI

Local AI for Omarchy: the model validated for your GPU, one button on the bar

Launch
140
B

Box

The most advanced, fully offline client-side AI suite on Android today

Launch
141
R

RWKV_APP

Cross-platform, local-first RWKV chat

Launch
142
Q

Qqqa

Fast, stateless LLM for your shell: qq answers; qa runs commands

Launch
143
L

Llama3.java

Llama 3+ inference in pure Java

Launch
144
G

Ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched

Launch
145
K

Kaas

Cross-platform desktop LLM client for OpenAI ChatGPT, DeepSeek R1

Launch
146
Q

Qwen38 Uncensored

Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack

Launch
147
F

Frugon

Free, local, open-source LLM cost analyzer

Launch
148
O

OpenGhost

Open desktop AI agent for Windows, macOS and Linux

Launch
149
C

Codirigent

A Rust based terminal workspace for multiple AI coding CLIs in parallel

Launch
150
A

aiq-deploy

Asked to install, deploy, run, validate, troubleshoot

Get