Skip to content
vLLM

Alternatives to vLLM

200 apps like vLLM, closest match first.

More like vLLM

101
O

Ollama Grid Search

A multi-platform desktop application to evaluate and compare LLM models

Launch
102
H

huawei-cloud-openviking-embedding-switch

Switch OpenViking's embedding model to a local llama-server

Get
103
O

overtchat

A simpler self-hosted alternative to Open WebUI

Launch
104
C

Camelid

A Rust-native local inference backend

Launch
105
M

Matrixhub

An Open-source, self-hosted AI model hub

Launch
106
A

Ava

All-in-one desktop app for running LLMs locally

Launch
107
L

Llmtrim

Local proxy that compresses your LLM API requests so you pay less

Launch
108
A

Audio.cpp

An all-in-one, pure C++ inference engine for audio models, powered by ggml

Launch
109
V

Vellum

Vellum helps developers build AI systems

Launch
110
C

Corpusos

Open-source protocol suite standardizing LLM, Vector, Graph

Launch
111
K

Keras LLM Robot

A web UI Project In order to learn the large language model

Launch
112
O

Open WebUI

Run AI on your own terms

Launch
113
M

Memlayer

Plug-and-play memory for LLMs in 3 lines of code

Launch
114
G

Gerbil

A desktop app for running Large Language Models locally

Launch
115
L

LLamaTuner

Easy and Efficient Finetuning LLMs

Launch
116
P

Portkey

Full-stack LLMOps platform to monitor, manage, and improve LLM-based apps

Launch
117
D

dialagram

Unlimited LLM API access through an OpenAI-compatible router

Launch
118
P

Pulsar

SSD-streaming inference engine for giant MoE models (Rust + CUDA)

Launch
119
O

ObsidianArc

A self-hosted AI platform with a Go server, multi-provider routing, usage…

Launch
120
M

Minimal LLM UI

Minimalistic UI for Ollama LMs - This powerful react interface for LLMs…

Launch
121
L

LLM Axe

A simple, intuitive toolkit for quickly implementing LLM powered applications

Launch
122
R

Rig

Build modular and scalable LLM Applications in Rust

Launch
123
X

Xybrid

Cross-platform on-device AI toolkit

Launch
124
C

cost-aware-llm-pipeline

Cost optimization patterns for LLM API usage

Get
125
L

Llmflows

Simple, Explicit and Transparent LLM Apps

Launch
126
D

Deep Infra

DeepInfra offers cost-effective, scalable, easy-to-deploy

Launch
127
J

jetson-package

Pick Jetson-compatible containers, vLLM runtime images

Get
128
L

Llocal

Aiming to provide a seamless and privacy driven chatting experience

Launch
129
N

Nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

Launch
130
A

AlphaNeuralAI

Call any AI model through one OpenAI-compatible API at the price on its page

Launch
131
O

Otari

Open-source, OpenAI-compatible LLM gateway you run yourself

Launch
132
E

ETOS-LLM-Studio

A native LLM client for iOS & Apple Watch

Launch
133
I

Inferly

LLM telemetry without touching prompt content

Launch
134
H

huggingface-best

About finding the best, top, or recommended model for a task

Get
135
O

OrcaRouter-Lite

Self-hosted LLM router with a managed safety net

Launch
136
I

Inference.net

Deploy and manage AI models

Launch
137
V

vMLX

Run local AI models on Apple Silicon

Launch
138
M

mlx-dspark

Up to 4× faster LLM decoding on Apple Silicon, lossless

Launch
139
O

OllaMan

Powerful Ollama AI Model Manager

Launch
140
O

OfflineLLM

Private on-device AI chat for Android

Launch
141
O

OfoxAI

One API key for 100+ LLMs. OpenAI-compatible

Launch
142
L

LLM API

Free LLM API: 100+ models, one single interface, and smart cost-aware analytics

Launch
143
A

Aikit

Fine-tune, build, and deploy open-source LLMs easily!

Launch
144
E

Embedbase

A dead-simple API to build LLM-powered apps

Launch
145
D

Dialog

RAG LLM Ops App for easy deployment and testing

Launch
146
T

transformers

Hugging Face Transformers for loading Hub models, running pipeline inference

Get
147
E

Envyon AI

Deploy powerful AI models on private, dedicated infrastructure

Launch
148
A

AndroLLM

Open-source Android AI using LiteRT-LM

Launch
149
E

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

Launch
150
L

Lambda

Deploy GPU clusters swiftly; extensive AI model training support

Launch