Skip to content
llama.cpp

Self-hosted alternatives to llama.cpp

200 self-hosted apps like llama.cpp, closest match first.

More like llama.cpp

51
P

Py Idp

AI-enabled Intelligent Document Processing for Python: 12+ LLM backends

Launch
52
A

Agentsystems

Self-hosted app store and runtime for AI agents

Launch
53
T

The OSS LLMOps Stack

Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…

Launch
54
O

Oriveo

Open-source, bring-your-own-key (BYOK) multi-model AI chat client for iOS…

Launch
55
U

Unsloth

Local UI to run and train LLMs and diffusion models

Launch
56
L

LLM LS

LSP server leveraging LLMs for code completion (and more?)

Launch
57
Q

Qwengate

Drop-in OpenAI-compatible API gateway for Qwen AI models

Launch
58
W

Webchat2api

OpenAI-compatible Web Chat API proxy

Launch
59
H

Helix

Private Agent Fleet with Spec Coding

Launch
60
N

Netron

Visualizer for neural network and machine learning models

Launch
61
A

Aivory

Self-hosted AI chat platform with multi-step tool calls, persistent Python…

Launch
62
O

Open Responses

Self-hosted alternative to OpenAI's Responses API compatible

Launch
63
G

GoGogot

Lightweight self-hosted AI agent. Open-source OpenClaw alternative in Go

Launch
64
G

GPTPortal

A feature-rich portal to chat with GPT-4, Claude, Gemini, Mistral, & OpenAI…

Launch
65
P

Pipelex

Build AI methods with your coding agent

Launch
66
O

Orbit

Self-hosted AI gateway for private RAG, natural-language data access

Launch
67
N

Netclode

Self hosted cloud coding agent with k3s + kata containers + cloud hypervisor…

Launch
68
O

ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3

Launch
69
L

LangGraph-GUI

Visual node-edge graph GUI editor for LangGraph and run

Launch
70
L

Local-Multimodal-AI-Chat

Self-hostable multimodal chat with local LLMs

Launch
71
Z

Zosma Cowork

A web-based AI workspace with a local execution daemon

Launch
72
A

API7 cloud

Deploy and manage projects effortlessly

Launch
73
K

Kortix Suna AI

Open-source AI Operating System: your agents, skills, memory

Launch
74
M

Marm Memory

Local-first 3-in-1 AI memory layer & MCP server for Claude Code, Codex, Grok

Launch
75
M

MultitaskAI

Master Your AI, Maximize Your Productivity!

Launch
76
O

OpenCode Superapp

Native, local-first AI workspace for Mac

Launch
77
Y

Yepanywhere

Self-hosted web UI for Claude and Codex

Launch
78
A

Argentos Core

Your own AI operating system

Launch
79
A

AgentsMesh

Self-hostable AI Agent Workforce Platform

Launch
80
H

HappyTorch

A PyTorch coding practice platform — covering LLM, Diffusion, PEFT, and more…

Launch
81
A

AsrServe

Self-hosted realtime and offline ASR

Launch
82
O

Octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

Launch
83
O

OpenAgentd

Open-source desktop app for a local coding agent

Launch
84
K

Kolosal AI

A software for local training, downloading

Launch
85
A

Agentic Signal

Visual AI agent workflow automation platform with local LLM integration

Launch
86
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

Launch
87
M

Moyai

A self-hosted coding agent for background work

Launch
88
A

Agenvoy

Self-hosted 24/7 personal AI agent that runs on your own machine

Launch
89
O

Octo Agent

Open-source, single-binary, self-hosted AI agent

Launch
90
P

Pydantic Deepagents

Open-source, self-hosted Claude Code

Launch
91
L

Latitude

AI Agent Observability & Monitoring

Launch
92
D

Dot

Text-To-Speech, RAG, and LLMs. All local!

Launch
93
H

Huf

Open-source, self-hosted multi-agent AI infrastructure for teams and apps

Launch
94
L

Locally Uncensored

The all-in-one local AI studio for your desktop: chat

Launch
95
O

OS

Enables organizations to create and deploy customizable AI agents

Launch
96
E

EpicStaff

Source-available, self-hosted platform for building AI agent flows

Launch
97
M

MOVO

Turn DeepSeek Harness into a self-hosted enterprise Agent platform

Launch
98
M

Memory OS

A 7-layer memory operating system for Hermes Agent

Launch
99
U

Unlimited-claude-AI

Claude AI. No backend, no server costs, 100% free

Launch
100
A

Airunner

Offline inference engine for art, real-time voice conversations

Launch