Skip to content
llama.cpp

Open source alternatives to llama.cpp

200 open source apps like llama.cpp, closest match first.

More like llama.cpp

101
L

Lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

Launch
102
T

ToolNeuron

Encrypted & Privacy First, On Android Device AI App

Launch
103
D

Deltafin

Run full Kimi K3 on a single device

Launch
104
P

Promptulate

Lightweight Large language model automation

Launch
105
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
106
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
107
C

Coai

Next Gen Multi-tenant AI One-Stop Solution

Launch
108
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
109
L

Langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability…

Launch
110
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
111
1

10x

Up to 20x faster AI coding with multi-step Superpowers

Launch
112
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
113
P

Parakeet

OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX)

Launch
114
B

Backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more

Launch
115
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch
116
L

Ling

The LLMs' framework optimized for ultra-fast response times

Launch
117
K

KokoroSharp

Fast local TTS inference engine in C# with ONNX runtime

Launch
118
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
119
K

Klee

A native macOS AI chat app powered by MLX

Launch
120
F

FreeLingo

Open-source, self-hosted AI language learning platform

Launch
121
L

LMRing

Open-source, self-hostable LLM arena

Launch
122
L

Lnwjud

Local AI-agent runtime & MCP gateway

Launch
123
C

ChatGPT

A ChatGPT C# client for MacOS, Windows, Linux, Android, iOS and Browser

Launch
124
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
125
S

SillyTavern

LLM Frontend for Power Users

Launch
126
U

Unsaged

Open source chat kit engineered for seamless interaction with AI models

Launch
127
L

LTX Video Mac

Native macOS app for local AI video on Apple Silicon

Launch
128
C

Chaty

Private, local AI desktop app

Launch
129
D

Deepseek Harness Desktop

Compact DeepSeek Harness desktop host

Launch
130
L

LiteLLM

Acts as a unified proxy across 100+ LLMs

Launch
131
O

Omarchy Local AI

Local AI for Omarchy: the model validated for your GPU, one button on the bar

Launch
132
B

Box

The most advanced, fully offline client-side AI suite on Android today

Launch
133
R

RWKV_APP

Cross-platform, local-first RWKV chat

Launch
134
Q

Qqqa

Fast, stateless LLM for your shell: qq answers; qa runs commands

Launch
135
L

Llama3.java

Llama 3+ inference in pure Java

Launch
136
G

Ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched

Launch
137
K

Kaas

Cross-platform desktop LLM client for OpenAI ChatGPT, DeepSeek R1

Launch
138
V

Vscode Unify Chat Provider

Integrate multiple LLM API providers into VS Code's GitHub Copilot Chat

Launch
139
Q

Qwen38 Uncensored

Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack

Launch
140
F

Frugon

Free, local, open-source LLM cost analyzer

Launch
141
O

OpenGhost

Open desktop AI agent for Windows, macOS and Linux

Launch
142
C

Codirigent

A Rust based terminal workspace for multiple AI coding CLIs in parallel

Launch
143
O

Openai Scala Client

Scala client for OpenAI API and other major LLM providers

Launch
144
W

Wisp Science

Open-source, local-first desktop AI research workbench

Launch
145
P

Pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA)

Launch
146
S

shoehorn

Make any language model fit your machine

Launch
147
G

Generative AI With Langchain

Build production-ready LLM applications and advanced agents

Launch
148
H

HyperQwen

Serve large Qwen models fast on the GPUs you actually own

Launch
149
O

Off Grid AI Desktop

Private, local-first AI for your Mac: local LLM chat, image generation

Launch
150
P

Parakeet.cpp

Ultra fast and portable Parakeet implementation

Launch