Skip to content
W

Willow Inference Server

Open source, local, and self-hosted highly optimized language inference…

by toveraincFree

Launch
#2383in AI
0In stores

Description

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

Ratings & Reviews

No ratings yet

Be the first to rate Willow Inference Server.

People also visit

S

SwanLab

An open-source, modern-design AI training tracking and visualization

AI
Launch
E

Enchanted

Enchanted is iOS and macOS app for chatting

AI
Launch
P

Project Maya

Run GLM-5.3-Flash (321B MoE) privately on your own GPU(s)…

AI
Launch
O

Open WebUI

Run AI on your own terms

AI
Launch
O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

AI
Launch
L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

AI
Launch

Willow Inference Server FAQ

What is Willow Inference Server?

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

Is Willow Inference Server free?

Yes. Willow Inference Server is free to use.

Do I need to download Willow Inference Server?

No. Willow Inference Server runs in your browser at github.com, so there's nothing to install.

Who makes Willow Inference Server?

Willow Inference Server is made by toverainc.

What are the best Willow Inference Server alternatives?

Popular alternatives to Willow Inference Server include SwanLab, Enchanted and Project Maya. See all Willow Inference Server alternatives

Developer Stuff

Badges