Olla — High-performance lightweight proxy and load balancer for LLM infrastructure · dotstore

Description

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.…

Information

Ratings & Reviews

No ratings yet

Be the first to rate Olla.

People also visit

O

ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3

AI

O

Open WebUI

Run AI on your own terms

AI

O

Ollama

Load and run large LLMs locally to use in your terminal or build your apps

AI

U

Unsloth

Local UI to run and train LLMs and diffusion models

AI

P

PhotoPrism

AI-Powered Photos App

AI

L

Langfuse

Trace, evaluate, and improve AI agents with one open platform

AI

See all Olla alternatives

Olla FAQ

What is Olla?

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

Is Olla free?

Yes. Olla is free to use.

Do I need to download Olla?

No. Olla runs in your browser at github.com, so there's nothing to install.

Who makes Olla?

Olla is made by thushan.

What are the best Olla alternatives?

Popular alternatives to Olla include ODS, Open WebUI and Ollama. See all Olla alternatives

Developer Stuff

Badges