Tebmer/Awesome-Knowledge-Distillation-of-LLMs

LLM Frameworks

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

GitHub →

4.0

GitHub Metrics

Stars

1.3k

Forks

Open Issues

Watchers

Contributors

Weekly Commits

Language

—

License

—

Last Commit

Mar 9, 2025

Created

Feb 8, 2024

Latest Release

—

Release Date

—

Synced: Oct 18, 2026

Quality Scores

Documentation Qualityw: 20%

4.4

No dedicated docs site. Description: 226 chars. Stars signal: 1,317. Contributors: 2. Score: 4.4/10

Community Healthw: 20%

4.3

Stars: 1,317. Contributors: 2. Watchers: 18. Forks: 76. Issue ratio: 0.3%. Score: 4.3/10

Maintenance Velocityw: 15%

1.0

Last commit: 587d ago. Weekly commits: 0. No releases published. Maturity bonus: 2.7y old. Score: 1/10

API Design & DXw: 20%

6.1

Stars/issues ratio: 329. No dedicated API docs. No license specified. Popularity signal: 1,317 stars. Score: 6.1/10

Production Readinessw: 15%

3.1

Battle-tested: 1,317 stars. Peer review: 2 contributors. No versioned releases. No license (risky for production). Age: 2.7 years. Maintenance: last commit 587d ago. Score: 3.1/10

Ecosystem Integrationw: 10%

4.0

Fork interest: 76. No license (integration risk). Adoption: 1,317 stars. Score: 4/10