xlite-dev/Awesome-LLM-Inference

Inference Engines

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

GitHub →

6.4

GitHub Metrics

Stars

5.5k

Forks

438

Open Issues

Watchers

135

Contributors

Weekly Commits

Language

Python

License

GPL-3.0

Last Commit

Aug 14, 2026

Created

Aug 27, 2023

Latest Release

v2.6.20

Release Date

Jun 17, 2025

Synced: Oct 17, 2026

Quality Scores

Documentation Qualityw: 20%

5.5

No dedicated docs site. Description: 127 chars. Stars signal: 5,531. Contributors: 40. Score: 5.5/10

Community Healthw: 20%

7.3

Stars: 5,531. Contributors: 40. Watchers: 135. Forks: 438. Issue ratio: 0.2%. Score: 7.3/10

Maintenance Velocityw: 15%

4.6

Last commit: 64d ago. Weekly commits: 0. Latest release: v2.6.20. Maturity bonus: 3.1y old. Score: 4.6/10

API Design & DXw: 20%

7.0

Stars/issues ratio: 553. Dynamic language: Python. No dedicated API docs. License: GPL-3.0. Popularity signal: 5,531 stars. Score: 7/10

Production Readinessw: 15%

6.9

Battle-tested: 5,531 stars. Peer review: 40 contributors. Versioned: v2.6.20. Licensed: GPL-3.0. Age: 3.1 years. Maintenance: last commit 64d ago. Score: 6.9/10

Ecosystem Integrationw: 10%

7.3

Fork interest: 438. Major ecosystem: Python. License: GPL-3.0. Adoption: 5,531 stars. Score: 7.3/10