Skip to content
llama.cpp

Free alternatives to llama.cpp

200 free apps like llama.cpp, closest match first.

More like llama.cpp

151
O

Openai Scala Client

Scala client for OpenAI API and other major LLM providers

Launch
152
P

picoclaw-ai-assistant

Ultra-lightweight AI assistant in Go that runs on $10 hardware

Get
153
P

Pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA)

Launch
154
S

shoehorn

Make any language model fit your machine

Launch
155
H

HyperQwen

Serve large Qwen models fast on the GPUs you actually own

Launch
156
P

Parakeet.cpp

Ultra fast and portable Parakeet implementation

Launch
157
T

Texts To Transformer

Train a tiny Transformer from scratch on your iMessage history

Launch
158
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
159
Q

Qwen3 TTS Apple Silicon

Run Qwen3-TTS text-to-speech locally on Mac (M1/M2/M3/M4)

Launch
160
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
161
J

jetson-llm-serve

Stand up vLLM or SGLang serving on Jetson

Get
162
M

MakeHub.ai

Your LLM traffic, always on the fastest & cheapest route

Launch
163
F

fine-tuning-expert

Fine-tuning LLMs, training custom models

Get
164
T

transformers

Hugging Face Transformers for loading Hub models, running pipeline inference

Get
165
O

oracle

ONNX Runtime inference daemon for ML-enhanced plugin capabilities

Get
166
A

ai-engineer

Build production-ready LLM applications, advanced RAG systems

Get
167
N

nemo-mbridge-perf-moe-dispatcher-selection

Choose the right MoE token dispatcher

Get
168
N

nemo-mbridge-perf-activation-recompute

Validate and use selective and full activation recompute in Megatron Bridge

Get
169
H

huawei-cloud-openviking-embedding-switch

Switch OpenViking's embedding model to a local llama-server

Get
170
A

Audio.cpp-webui

audio.cpp with a full-task WebUI - pure C++ audio-model inference engine…

Launch
171
1

120 AI Chat

Private multi-model AI desktop app

Launch
172
S

Sherpa Onnx

Speech-to-text, text-to-speech, speaker diarization, speech enhancement

Launch
173
T

tao-finetune-huggingface-model

Fine-tune any HuggingFace CV / VLM / LLM model on local NVIDIA GPUs inside an

Get
174
O

openrouter-typescript-sdk

Complete reference for integrating

Get
175
C

CrispASR

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe

Launch
176
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
177
T

Transformer Lab

100% Open Source Toolkit for Large Language Models: Train, Tune

Launch
178
G

GPT4All

GPT4All runs open-source language models locally on Windows, macOS

Launch
179
N

nemo-automodel-launcher-config

Configure NeMo AutoModel job launches for interactive runs, Slurm clusters

Get
180
L

langchain4j-mcp-server-patterns

Provides LangChain4j patterns for implementing MCP

Get
181
K

Kronk

Go With Your Own Intelligence

Launch
182
P

physical-ai-infrastructure-setup-and-resilient-scaling

Set up, scale, validate, or harden NVIDIA physical AI infrastructure

Get
183
A

ai-architect

Practical AI/ML implementation, LLM integration

Get
184
T

ttommyth/interactive-mcp

Interactive LLM workflows

Get
185
C

Cloudoora GenAI Platform

Enterprise AI Deployment & Infrastructure Platform

Launch
186
T

tilegym-converting-cutile-to-triton

Converts cuTile GPU kernels (@ct.kernel) to Triton (@triton.jit)

Get
187
N

nemo-mbridge-perf-cuda-graphs

Validate and use CUDA graph capture in Megatron Bridge

Get
188
L

Laya Coreml

Local Laya typed decisions on Apple Core ML and Neural Engine

Launch
189
D

deep-learning-pytorch

Expert guidance for deep learning, transformers, diffusion models

Get
190
B

build-models

Package and build custom AI models with Cog for deployment on Replicate

Get
191
A

API7 cloud

Deploy and manage projects effortlessly

Launch
192
M

MiniCPM5-2B WebGPU Pi

A coding agent running entirely in your browser

Launch
193
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
194
C

Convert to ONNX

Convert a Hugging Face model to ONNX format

Launch
195
Q

Qwen 2.5 Code Interpreter

Powered by Qwen, WebLLM, and Pyodide

Launch
196
L

Llamactl

Unified management and routing for llama.cpp, MLX and vLLM models

Launch
197
J

jetson-llm-benchmark

Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp

Get
198
I

Iris Android

IRIS is an android app for interfacing with GGUF / llama.cpp models locally

Launch
199
I

Icebreaker

A local AI chat app powered by Rust, iced, Hugging Face, and llama.cpp

Launch
200
S

Strix Halo Llamacpp

Performance-tuned llama.cpp for AMD Strix Halo

Launch