V
vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server
by waybarriosFree
#1097in AI
0In stores
Description
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.…
Ratings & Reviews
No ratings yet
Be the first to rate vllm-mlx.
People also visit
vllm-mlx FAQ
What is vllm-mlx?
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Is vllm-mlx free?
Yes. vllm-mlx is free to use.
Do I need to download vllm-mlx?
No. vllm-mlx runs in your browser at vllm-mlx.is-a.dev, so there's nothing to install.
Who makes vllm-mlx?
vllm-mlx is made by waybarrios.
What are the best vllm-mlx alternatives?
Popular alternatives to vllm-mlx include Rapid-MLX, mlx-serve and ECC. See all vllm-mlx alternatives