#37in AI
0In stores
Description
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.…
Preview
Ratings & Reviews
No ratings yet
Be the first to rate llama.cpp.
People also visit
llama.cpp FAQ
What is llama.cpp?
C/C++ inference engine for large language models, supporting quantization, multi-GPU, Apple Silicon, and an OpenAI-compatible server across a wide range of hardware.
What are the best llama.cpp alternatives?
Popular alternatives to llama.cpp include whatcani.run, mlx-serve and TurboLLM. See all llama.cpp alternatives

