STACKQUADRANT

ServerlessLLM/ServerlessLLM

Model Serving

Serverless LLM Serving for Everyone.

5.9
GitHub Metrics
Stars
685
Forks
73
Open Issues
45
Watchers
11
Contributors
18
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
May 4, 2026
Created
Jan 23, 2024
Latest Release
v0.8.0
Release Date
Nov 3, 2025
Synced: Jun 3, 2026
Quality Scores
Documentation Qualityw: 20%
6.1

Has docs site (https://serverlessllm.github.io/). Description: 36 chars. Stars signal: 685. Contributors: 18. Score: 6.1/10

Community Healthw: 20%
4.5

Stars: 685. Contributors: 18. Watchers: 11. Forks: 73. Issue ratio: 6.6%. Score: 4.5/10

Maintenance Velocityw: 15%
6.1

Last commit: 30d ago. Weekly commits: 0. Latest release: v0.8.0. Maturity bonus: 2.4y old. Score: 6.1/10

API Design & DXw: 20%
6.6

Stars/issues ratio: 15. Dynamic language: Python. Has documentation site. Permissive license: Apache-2.0. Popularity signal: 685 stars. Score: 6.6/10

Production Readinessw: 15%
6.0

Battle-tested: 685 stars. Peer review: 18 contributors. Versioned: v0.8.0. Licensed: Apache-2.0. Age: 2.4 years. Maintenance: last commit 30d ago. Score: 6/10

Ecosystem Integrationw: 10%
6.5

Fork interest: 73. Major ecosystem: Python. Integration-friendly: Apache-2.0. Adoption: 685 stars. Has web presence. Score: 6.5/10

Tags
cudahuggingface-transformerslarge-language-modelsmodel-as-a-servicemodel-servingpytorchserverless-inference
Radar
Documentation Quality
Community Health
Maintenance Velocity
API Design & DX
Production Readiness
Ecosystem Integration