ModelTC/LightLLM
Model ServingLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
GitHub Metrics
Stars
3.9k
Forks
302
Open Issues
116
Watchers
33
Contributors
42
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
Mar 2, 2026
Created
Jul 22, 2023
Latest Release
v1.1.0
Release Date
Sep 3, 2025
Synced: Mar 3, 2026
Quality Scores
Documentation Qualityw: 20%
0.0
Community Healthw: 20%
0.0
Maintenance Velocityw: 15%
0.0
API Design & DXw: 20%
0.0
Production Readinessw: 15%
0.0
Ecosystem Integrationw: 10%
0.0
Tags
deep-learninggptllamallmmodel-servingnlpopenai-triton
Radar
No scores yet