Skip to content
llama.cpp

Alternatives to llama.cpp

200 apps like llama.cpp, closest match first.

More like llama.cpp

151
L

Ling

The LLMs' framework optimized for ultra-fast response times

Launch
152
L

LLM API

Free LLM API: 100+ models, one single interface, and smart cost-aware analytics

Launch
153
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
154
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
155
C

Chaty

Private, local AI desktop app

Launch
156
G

Ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched

Launch
157
S

Synexa AI

Simple, fast, and stable. Deploy AI models with just one line of code

Launch
158
A

ai/gateway

One API for every frontier and open-weight model

Launch
159
A

aiq-deploy

Asked to install, deploy, run, validate, troubleshoot

Get
160
P

picoclaw-ai-assistant

Ultra-lightweight AI assistant in Go that runs on $10 hardware

Get
161
S

shoehorn

Make any language model fit your machine

Launch
162
H

HyperQwen

Serve large Qwen models fast on the GPUs you actually own

Launch
163
P

Parakeet.cpp

Ultra fast and portable Parakeet implementation

Launch
164
T

Texts To Transformer

Train a tiny Transformer from scratch on your iMessage history

Launch
165
I

Inference.net

Deploy and manage AI models

Launch
166
L

Local LLM

Pay once

Launch
167
Q

Qwen3 TTS Apple Silicon

Run Qwen3-TTS text-to-speech locally on Mac (M1/M2/M3/M4)

Launch
168
J

jetson-llm-serve

Stand up vLLM or SGLang serving on Jetson

Get
169
M

Molten

Molten brings AI to your devices—completely local, completely private

Launch
170
C

Cheaper Inference

One OpenAI-compatible API for discounted access to 97 AI models

Launch
171
F

fine-tuning-expert

Fine-tuning LLMs, training custom models

Get
172
T

transformers

Hugging Face Transformers for loading Hub models, running pipeline inference

Get
173
O

oracle

ONNX Runtime inference daemon for ML-enhanced plugin capabilities

Get
174
Q

Qiskit Documentation MCP Server

A collection of MCP servers to allow LLMs

Get
175
A

AISIX AI Gateway

Open-source AI gateway for LLMs & AI agents, built in Rust

Get
176
A

ai-engineer

Build production-ready LLM applications, advanced RAG systems

Get
177
N

nemo-mbridge-perf-moe-dispatcher-selection

Choose the right MoE token dispatcher

Get
178
G

GPUX.AI

Auto-scale AI models, GPU-accelerated computing, and easy deployment

Launch
179
E

Envyon AI

Deploy powerful AI models on private, dedicated infrastructure

Launch
180
W

WhatLLM.org

A platform for LLM models comparisons and benchmarking

Launch
181
N

nemo-mbridge-perf-activation-recompute

Validate and use selective and full activation recompute in Megatron Bridge

Get
182
Q

Qiskit Code Assistant MCP Server

A collection of MCP servers to allow LLMs

Get
183
N

NeutralLM

Discover, download, and run language models directly on your device

Launch
184
H

huawei-cloud-openviking-embedding-switch

Switch OpenViking's embedding model to a local llama-server

Get
185
A

Audio.cpp-webui

audio.cpp with a full-task WebUI - pure C++ audio-model inference engine…

Launch
186
S

Sherpa Onnx

Speech-to-text, text-to-speech, speaker diarization, speech enhancement

Launch
187
T

tao-finetune-huggingface-model

Fine-tune any HuggingFace CV / VLM / LLM model on local NVIDIA GPUs inside an

Get
188
O

oll.am

Pay once, use any AI model

Launch
189
O

openrouter-typescript-sdk

Complete reference for integrating

Get
190
C

CrispASR

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe

Launch
191
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
192
A

ai-architect

Practical AI/ML implementation, LLM integration

Get
193
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
194
Q

Quenderin

Quenderin runs open language models on your device

Launch
195
M

MiniCPM5-2B WebGPU Pi

A coding agent running entirely in your browser

Launch
196
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
197
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
198
J

jetson-llm-benchmark

Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp

Get
199
I

Iris Android

IRIS is an android app for interfacing with GGUF / llama.cpp models locally

Launch
200
S

Strix Halo Llamacpp

Performance-tuned llama.cpp for AMD Strix Halo

Launch