STACKQUADRANT

ServerlessLLM/ServerlessLLM

Model Serving

Serverless LLM Serving for Everyone.

5.7
GitHub Metrics
Stars
718
Forks
78
Open Issues
46
Watchers
11
Contributors
18
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
Sep 4, 2026
Created
Jan 23, 2024
Latest Release
v0.8.0
Release Date
Nov 3, 2025
Synced: Oct 17, 2026
Quality Scores
Documentation Qualityw: 20%
6.1

Has docs site (https://serverlessllm.github.io/). Description: 36 chars. Stars signal: 718. Contributors: 18. Score: 6.1/10

Community Healthw: 20%
4.5

Stars: 718. Contributors: 18. Watchers: 11. Forks: 78. Issue ratio: 6.4%. Score: 4.5/10

Maintenance Velocityw: 15%
5.0

Last commit: 43d ago. Weekly commits: 0. Latest release: v0.8.0. Maturity bonus: 2.7y old. Score: 5/10

API Design & DXw: 20%
6.6

Stars/issues ratio: 16. Dynamic language: Python. Has documentation site. Permissive license: Apache-2.0. Popularity signal: 718 stars. Score: 6.6/10

Production Readinessw: 15%
5.9

Battle-tested: 718 stars. Peer review: 18 contributors. Versioned: v0.8.0. Licensed: Apache-2.0. Age: 2.7 years. Maintenance: last commit 43d ago. Score: 5.9/10

Ecosystem Integrationw: 10%
6.6

Fork interest: 78. Major ecosystem: Python. Integration-friendly: Apache-2.0. Adoption: 718 stars. Has web presence. Score: 6.6/10

Tags
cudahuggingface-transformerslarge-language-modelsmodel-as-a-servicemodel-servingpytorchserverless-inference
Radar
Documentation Quality
Community Health
Maintenance Velocity
API Design & DX
Production Readiness
Ecosystem Integration