Skip to content
shoehorn

Open source alternatives to shoehorn

200 open source apps like shoehorn, closest match first.

Top picks

  1. L

    llama.cpp

    Launch

    C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.

    Open source

  2. B

    BodhiApp

    Launch

    Unified AI gateway combining local LLM inference, cloud API proxying, and MCP tool integration with built-in chat UI and enterprise access control.

    Open source

  3. A

    Aikit

    Launch

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

    Open source

  4. T

    TurboLLM

    Launch

    Run open AI models on your own machine — no cloud, no account, fully offline. Any GGUF model on any llama.cpp-compatible engine, auto-tuned to your hardware, with real measured tokens/sec before you download, a fast browser UI, and an OpenA

    Open sourceSelf-hosted

  5. W

    whatcani.run

    Launch

    whatcani.run helps you find the best AI models to run locally and how to run them, based on real data from trials that people ran on their own hardware. Each model is listed with its runtime, decode and prefill speed, time to first token, p

    Open source

  6. H

    HyperQwen

    Launch

    Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant

    Open source

More like shoehorn

7
H

huggingface/hugging-face-model-trainer

Train models with TRL: SFT, DPO, GRPO, GGUF conversion

Get
8
W

WebLLM Chat

Chat with AI large language models running natively in your browser

Launch
9
X

Xybrid

Cross-platform on-device AI toolkit

Launch
10
T

TRAE-Ollama-Bridge

Encapsulate the local Ollama into an OpenAI-compatible API

Launch
11
M

Minion

A tiny single-file coding agent for self-hosted models

Launch
12
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
13
L

Llmaker

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Launch
14
O

OfflineLLM

Private on-device AI chat for Android

Launch
15
F

Frugon

Free, local, open-source LLM cost analyzer

Launch
16
L

Litmux

Unit tests for AI. Test prompts, compare models, save money

Launch
17
L

Llamafarm

Deploy any AI model, agent, database, RAG

Launch
18
N

nanochat-llm-training

Train your own GPT-2 level LLM for under $100

Get
19
L

LMRing

Open-source, self-hostable LLM arena

Launch
20
C

Chipper

AI interface for tinkerers (Ollama, Haystack RAG, Python)

Launch
21
Q

Qwen38 Uncensored

Local Qwen 3.8 27B uncensored Q4_K_M + harvested SYSTEM pack

Launch
22
N

NadirClaw

Source-available LLM router and AI cost optimizer

Launch
23
L

Labml

Monitor deep learning model training and hardware usage from your mobile phone

Launch
24
A

AI LLM Comparison

A website where you can compare every AI Model

Launch
25
H

Hollama

A minimal LLM chat app that runs entirely in your browser

Launch
26
C

ChatLLM-Web

Private local model studio, AI chat

Launch
27
F

Faster Chat

A blazingly fast, privacy first & OPEN AI Chat Interface

Launch
28
N

Nativ

Local AI, native to your Mac

Launch
29
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
30
G

Ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched

Launch
31
M

Misceo

Local Anthropic-compatible AI gateway

Launch
32
I

Inferock Bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini

Launch
33
U

UnoRouter

Open-source LLM gateway: 300+ AI models behind one OpenAI-compatible key

Launch
34
U

Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source…

Launch
35
Q

Qwen3.6-windows-server

One-click Qwen3.6-27B inference on Windows

Launch
36
P

Picollm

On-device LLM Inference Powered by X-Bit Quantization

Launch
37
O

OpenGateLLM

An open-source, unified interface for running and managing self-hosted LLMs

Launch
38
C

Comfyui Triton And Sageattention Installer

Cross-platform installer for Triton and SageAttention on ComfyUI

Launch
39
O

Onnx Web

web UI for GPU-accelerated ONNX pipelines like Stable Diffusion

Launch
40
M

Memlayer

Plug-and-play memory for LLMs in 3 lines of code

Launch
41
S

SillyTavern

LLM Frontend for Power Users

Launch
42
P

PyGPT

Desktop AI Assistant powered by GPT-6, GPT-5, Gemini, Claude, Grok, Ollama

Launch
43
V

VoidLLM

Privacy-first LLM proxy and AI gateway

Launch
44
F

Free-GPT4-WEB-API

Not just GPT4! Easy to use, Self-Hosted

Launch
45
G

Gradio

Demo ML models, interact with them from any device, and build ML apps in minutes

Launch
46
G

Guaardvark

Self-hosted AI studio on your own GPU: chat with your files

Launch
47
P

Promptulate

Lightweight Large language model automation

Launch
48
M

MLX-LoRA-Studio

A native Mac App for LLM fine-tuning on Apple Silicon

Launch
49
S

Sipp

AI inference, packed simply

Launch
50
R

Routerly.ai

Self-hosted LLM gateway that routes requests across AI providers

Launch

About shoehorn

S

shoehorn

Make any language model fit your machine

shoehorn is a tool for making a language model fit the memory your machine actually has. Preset quantizations ignore your hardware: you pick one that fits and either waste quality headroom or find out at load time that it does not fit. shoehorn starts from the memory you have, subtracts what inference needs, and solves a per-tensor mixed-precision assignment, so it spends the remaining budget on the tensors where extra precision buys the most quality. The site's example fits a Qwen3 4B model into a 519 MiB weights budget, using 99.998 percent of it. The workflow quantizes a BF16 GGUF file with an importance matrix, then runs the result with llama.cpp, which must be on your PATH. The command line tool includes a local web app, started with shoehorn ui, where you pick a model, press one button and chat. The site also has a Find models page that scans popular Hugging Face models for ones that fit a chosen machine, such as a Mac with 8 to 128 GB or a GPU with 8 to 32 GB of VRAM, and a context length setting. Installation is available through Homebrew, as release downloads for macOS, Linux and Windows, or from source with cargo. The tool is MIT licensed. Its quantizer is written from scratch in Rust, and it produces standard GGUF v3 files that llama.cpp based tools can load.

Price
Open source
Category
Finance
Website
notactuallytreyanastasio.github.io