raketenkater/ggrun
Model ServingAuto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.
No dedicated docs site. Description: 275 chars. Stars signal: 267. Contributors: 3. Score: 3.9/10
Stars: 267. Contributors: 3. Watchers: 4. Forks: 15. Issue ratio: 0.0%. Score: 2.7/10
Last commit: 0d ago. Weekly commits: 8. Latest release: v3.2.8. Score: 9.1/10
Stars/issues ratio: 267. Typed language: Go. No dedicated API docs. Permissive license: MIT. Popularity signal: 267 stars. Score: 7.1/10
Battle-tested: 267 stars. Peer review: 3 contributors. Versioned: v3.2.8. Licensed: MIT. Age: 0.5 years. Maintenance: last commit 0d ago. Score: 3.5/10
Fork interest: 15. Major ecosystem: Go. Integration-friendly: MIT. Adoption: 267 stars. Score: 4.7/10