STACKQUADRANT

ServerlessLLM/ServerlessLLM

Model Serving

Serverless LLM Serving for Everyone.

5.7
GitHub Metrics
Stars
692
Forks
75
Open Issues
45
Watchers
11
Contributors
18
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
May 4, 2026
Created
Jan 23, 2024
Latest Release
v0.8.0
Release Date
Nov 3, 2025
Synced: Jul 18, 2026
Quality Scores
Documentation Qualityw: 20%
6.1

Has docs site (https://serverlessllm.github.io/). Description: 36 chars. Stars signal: 692. Contributors: 18. Score: 6.1/10

Community Healthw: 20%
4.5

Stars: 692. Contributors: 18. Watchers: 11. Forks: 75. Issue ratio: 6.5%. Score: 4.5/10

Maintenance Velocityw: 15%
5.2

Last commit: 75d ago. Weekly commits: 0. Latest release: v0.8.0. Maturity bonus: 2.5y old. Score: 5.2/10

API Design & DXw: 20%
6.6

Stars/issues ratio: 15. Dynamic language: Python. Has documentation site. Permissive license: Apache-2.0. Popularity signal: 692 stars. Score: 6.6/10

Production Readinessw: 15%
5.7

Battle-tested: 692 stars. Peer review: 18 contributors. Versioned: v0.8.0. Licensed: Apache-2.0. Age: 2.5 years. Maintenance: last commit 75d ago. Score: 5.7/10

Ecosystem Integrationw: 10%
6.5

Fork interest: 75. Major ecosystem: Python. Integration-friendly: Apache-2.0. Adoption: 692 stars. Has web presence. Score: 6.5/10

Tags
cudahuggingface-transformerslarge-language-modelsmodel-as-a-servicemodel-servingpytorchserverless-inference
Radar
Documentation Quality
Community Health
Maintenance Velocity
API Design & DX
Production Readiness
Ecosystem Integration