Tiiny-AI/PowerInfer

Inference Engines

High-speed Large Language Model Serving for Local Deployment

GitHub →

6.8

GitHub Metrics

Stars

9.6k

Forks

589

Open Issues

129

Watchers

102

Contributors

399

Weekly Commits

Language

C++

License

MIT

Last Commit

May 11, 2026

Created

Dec 15, 2023

Latest Release

—

Release Date

—

Synced: Jul 18, 2026

Quality Scores

Documentation Qualityw: 20%

6.0

No dedicated docs site. Description: 60 chars. Stars signal: 9,643. Contributors: 399. Score: 6/10

Community Healthw: 20%

8.3

Stars: 9,643. Contributors: 399. Watchers: 102. Forks: 589. Issue ratio: 1.3%. Score: 8.3/10

Maintenance Velocityw: 15%

4.8

Last commit: 68d ago. Weekly commits: 0. No releases published. Maturity bonus: 2.6y old. Score: 4.8/10

API Design & DXw: 20%

7.0

Stars/issues ratio: 75. No dedicated API docs. Permissive license: MIT. Popularity signal: 9,643 stars. Score: 7/10

Production Readinessw: 15%

7.2

Battle-tested: 9,643 stars. Peer review: 399 contributors. No versioned releases. Licensed: MIT. Age: 2.6 years. Maintenance: last commit 68d ago. Score: 7.2/10

Ecosystem Integrationw: 10%

7.6

Fork interest: 589. Ecosystem: C++. Integration-friendly: MIT. Adoption: 9,643 stars. Score: 7.6/10