Self-hosted alternatives to shoehorn
200 self-hosted apps like shoehorn, closest match first.
Top picks
- T

TurboLLM
LaunchRun open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA
Open sourceSelf-hosted
- M
Minion
LaunchA tiny single-file coding agent for self-hosted models (llama.cpp / vLLM / SGLang).
Open sourceSelf-hosted
- M

Matrixhub
LaunchMatrixHub is an open-source, self-hosted model registry for AI models, built to work with vLLM and SGLang. It is meant to be a private replacement for Hugging Face inside your own infrastructure, in the way Harbor serves Docker Hub. Its tra
Open sourceSelf-hosted
- L
Llmaker
LaunchModels, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
Open sourceSelf-hosted
- L

LMRing
Launchlmring is a web app for comparing AI models side by side. You pick up to four models from more than 50 providers, including OpenAI, Anthropic, Google, Meta, Mistral and DeepSeek, then write one prompt and send it to all of them at once. Res
Open sourceSelf-hosted
- N
NadirClaw
LaunchSource-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, n
Open sourceSelf-hosted
More like shoehorn
OmniKey-AI-Unified-Key-Manager
A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini…
Self-Hosted AI Stack
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document…

Inference Gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM…
CatGPT-Gateway
Turn your ChatGPT or Claude account into a fully working OpenAI-compatible API
About shoehorn
shoehorn
Make any language model fit your machine
shoehorn is a tool for making a language model fit the memory your machine actually has. Preset quantizations ignore your hardware: you pick one that fits and either waste quality headroom or find out at load time that it does not fit. shoehorn starts from the memory you have, subtracts what inference needs, and solves a per-tensor mixed-precision assignment, so it spends the remaining budget on the tensors where extra precision buys the most quality. The site's example fits a Qwen3 4B model into a 519 MiB weights budget, using 99.998 percent of it. The workflow quantizes a BF16 GGUF file with an importance matrix, then runs the result with llama.cpp, which must be on your PATH. The command line tool includes a local web app, started with shoehorn ui, where you pick a model, press one button and chat. The site also has a Find models page that scans popular Hugging Face models for ones that fit a chosen machine, such as a Mac with 8 to 128 GB or a GPU with 8 to 32 GB of VRAM, and a context length setting. Installation is available through Homebrew, as release downloads for macOS, Linux and Windows, or from source with cargo. The tool is MIT licensed. Its quantizer is written from scratch in Rust, and it produces standard GGUF v3 files that llama.cpp based tools can load.
- Price
- Open source
- Category
- Finance
- Website
- notactuallytreyanastasio.github.io

