HuaizhengZhang/AI-Infra-from-Zero-to-Hero

Model Serving

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

GitHub →Website →

6.2

GitHub Metrics

Stars

4.1k

Forks

393

Open Issues

Watchers

133

Contributors

Weekly Commits

Language

—

License

MIT

Last Commit

Jul 25, 2025

Created

Jan 7, 2019

Latest Release

—

Release Date

—

Synced: Jun 3, 2026

Quality Scores

Documentation Qualityw: 20%

7.4

Has docs site (https://huaizheng.xyz/). Description: 256 chars. Stars signal: 4,074. Contributors: 25. Score: 7.4/10

Community Healthw: 20%

7.0

Stars: 4,074. Contributors: 25. Watchers: 133. Forks: 393. Issue ratio: 0.3%. Score: 7/10

Maintenance Velocityw: 15%

1.7

Last commit: 313d ago. Weekly commits: 0. No releases published. Maturity bonus: 7.4y old. Score: 1.7/10

API Design & DXw: 20%

7.9

Stars/issues ratio: 291. Has documentation site. Permissive license: MIT. Popularity signal: 4,074 stars. Score: 7.9/10

Production Readinessw: 15%

5.3

Battle-tested: 4,074 stars. Peer review: 25 contributors. No versioned releases. Licensed: MIT. Age: 7.4 years. Maintenance: last commit 313d ago. Score: 5.3/10

Ecosystem Integrationw: 10%

6.9

Fork interest: 393. Integration-friendly: MIT. Adoption: 4,074 stars. Has web presence. Score: 6.9/10