Description
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.…
Information
Ratings & Reviews
No ratings yet
Be the first to rate Fastllm-proxy.
People also visit
The OSS LLMOps Stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies…
Fastllm-proxy FAQ
What is Fastllm-proxy?
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
Is Fastllm-proxy free?
Yes. Fastllm-proxy is free to use.
Do I need to download Fastllm-proxy?
No. Fastllm-proxy runs in your browser at fastllm.azrty.com, so there's nothing to install.
Who makes Fastllm-proxy?
Fastllm-proxy is made by azrtydxb.
What are the best Fastllm-proxy alternatives?
Popular alternatives to Fastllm-proxy include pooled, Antseed and The OSS LLMOps Stack. See all Fastllm-proxy alternatives