Tiiny-AI/PowerInfer

Inference Engines

High-speed Large Language Model Serving for Local Deployment

GitHub Metrics

Stars

8.7k

Forks

491

Open Issues

125

Watchers

Contributors

399

Weekly Commits

Language

C++

License

MIT

Last Commit

Jan 24, 2026

Created

Dec 15, 2023

Latest Release

—

Release Date

—

Synced: Mar 3, 2026

Quality Scores

Documentation Qualityw: 20%

0.0

Community Healthw: 20%

0.0

Maintenance Velocityw: 15%

0.0

API Design & DXw: 20%

0.0

Production Readinessw: 15%

0.0

Ecosystem Integrationw: 10%

0.0