Skip to content
G

Ggrun

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched

by raketenkaterFree

Launch
#4262in AI
0In stores

Description

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Information

Ratings & Reviews

No ratings yet

Be the first to rate Ggrun.

People also visit

F

Fox

A local LLM server built for concurrent work

AI
Launch
L

Llamafile

Distribute and run LLMs with a single file

AI
Launch
V

Viseron

Self-hosted, local only NVR and AI Computer Vision software

AI
Launch
O

ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3

AI
Launch
C

Chatterbox TTS API

Local, OpenAI-compatible text-to-speech

AI
Launch
P

Project Maya

Run GLM-5.3-Flash (321B MoE) privately on your own GPU(s)…

AI
Launch

Ggrun FAQ

What is Ggrun?

llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

Is Ggrun free?

Yes. Ggrun is free to use.

Do I need to download Ggrun?

No. Ggrun runs in your browser at github.com, so there's nothing to install.

Who makes Ggrun?

Ggrun is made by raketenkater.

What are the best Ggrun alternatives?

Popular alternatives to Ggrun include Fox, Llamafile and Viseron. See all Ggrun alternatives

Developer Stuff

Badges