Skip to content
llama.cpp

Alternatives to llama.cpp

200 apps like llama.cpp, closest match first.

More like llama.cpp

101
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch
102
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
103
M

Magnitude

Run open models as fast as your hardware allows

Launch
104
R

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM…

Launch
105
C

Cherry Studio

A desktop client that supports multiple large language model (LLM) providers

Launch
106
A

Anubis Oss

Local LLM Testing & Benchmarking for Apple Silicon

Launch
107
B

Baidu PaddlePaddle

Develop adaptive AI solutions effortlessly, leverage GPU acceleration

Launch
108
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
109
T

Tenere

TUI for LLMs

Launch
110
L

Llamafile

Distribute and run LLMs with a single file

Launch
111
O

Openclaw.net

Self-hosted Enterprise and Personal AI + agent runtime in .NET

Launch
112
G

GPT Mobile

Chat app for Android that supports answers from multiple LLMs at once

Launch
113
D

Devo

Model-neutral agent desktop/runtime for private, enterprise

Launch
114
A

Alpaca

Local and online AI hub

Launch
115
Q

Qiskit Gym MCP Server

A collection of MCP servers to allow LLMs

Get
116
D

Daan

Lightweight LLM Client with MCP & Characters

Launch
117
N

Nesa

Run AI models end-to-end encrypted

Launch
118
A

apple-on-device-ai

Build private, on-device AI features on iPhone, iPad, and Mac

Get
119
M

Msty

Use Llama 3, GPT-4o, Mixtral, Gemma, etc. on your computer. Ultimate privacy

Launch
120
E

EmpirioLabs AI

Low-cost AI Infrastructure Platform

Launch
121
Q

Qiskit IBM Transpiler MCP Server

A collection of MCP servers to allow LLMs

Get
122
H

huggingface-best

About finding the best, top, or recommended model for a task

Get
123
C

Corpusos

Open-source protocol suite standardizing LLM, Vector, Graph

Launch
124
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
125
O

OmniKey-AI-Unified-Key-Manager

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…

Launch
126
N

Nacho Flow

Agent Supervisor & Model Dispatcher for coding agents (spicebox.dev/nacho-flow)

Launch
127
F

freellmpool

Free LLM gateway: 22 LLM providers, 178 enabled chat routes

Get
128
G

GoModel

AI gateway / AI control plane / AI proxy written in Go

Get
129
S

Swarm

Type-safe tools, on-device inference, multi-agent workflows, memory

Launch
130
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
131
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
132
C

Chorus

Chat with multiple AI models on Mac

Launch
133
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
134
M

MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for…

Launch
135
T

ToolNeuron

Encrypted & Privacy First, On Android Device AI App

Launch
136
D

Deltafin

Run full Kimi K3 on a single device

Launch
137
P

Promptulate

Lightweight Large language model automation

Launch
138
Y

YoloRouter

A self-hosted, OpenAI-compatible LLM gateway

Launch
139
A

AlphaNeuralAI

Call any AI model through one OpenAI-compatible API at the price on its page

Launch
140
J

jetson-inference-mem-tune

Pick the serving stack and per-runtime memory flags

Get
141
F

Fastllm-proxy

The lowest-overhead LLM router

Launch
142
M

Mirai

Inference engine for AI models

Launch
143
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
144
P

Private AI Chat

Local In-Browser LLM Inference

Launch
145
D

dialagram

Unlimited LLM API access through an OpenAI-compatible router

Launch
146
S

SourceWeft

Open-source, self-hostable alternative to ChatGPT and NotebookLM

Launch
147
O

OpenAgentCore

Open-source, self-hosted implementation of the OpenAI Agents API

Launch
148
P

Parakeet

OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX)

Launch
149
A

Auriko

One API to easily switch LLM models, reduce inference cost, and stay reliable

Launch
150
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch