STACKQUADRANT

Fine-tuning Tools

Tools for fine-tuning, training, and adapting foundation models

58 repos

Unsloth

8.9

Unsloth — a leading open-source project in the AI/LLM ecosystem.

★ 78.2k◇ 7.2kPython

hiyouga/LlamaFactory

8.3

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

★ 75.5k◇ 9.3kPython

huggingface/peft

8.7

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

★ 21.8k◇ 2.7kPython

ConardLi/easy-dataset

6.9

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

★ 15.0k◇ 1.6kJavaScript

axolotl-ai-cloud/axolotl

7.9

Go ahead and axolotl questions

★ 12.6k◇ 1.5kPython

ludwig-ai/ludwig

8.1

Low-code framework for building custom LLMs, neural networks, and other AI models

★ 11.8k◇ 1.3kPython

skypilot-org/skypilot

8.3

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

★ 10.7k◇ 1.3kPython

MakazhanAlpamys/Soup

8.0

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

★ 9.3k◇ 1.5kPython

flyteorg/flyte

8.4

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

★ 7.7k◇ 904Go

linkedin/Liger-Kernel

7.9

Efficient Triton Kernels for LLM Training

★ 6.7k◇ 626Python

vllm-project/semantic-router

7.6

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

★ 6.2k◇ 1.1kGo

h2oai/h2o-llmstudio

7.7

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

★ 5.2k◇ 556Python

amitshekhariitbhu/ai-engineering-interview-questions

6.3

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

★ 3.5k◇ 630Markdown

aiming-lab/MetaClaw

6.1

Just talk to your agent — it learns and EVOLVES.

★ 3.5k◇ 450Python

decodingai-magazine/second-brain-ai-assistant-course

5.9

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

★ 3.1k◇ 527Jupyter Notebook

ashishpatel26/LLM-Finetuning

4.3

LLM Finetuning with peft

★ 3.0k◇ 769Jupyter Notebook

stochasticai/xTuring

6.9

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

★ 2.7k◇ 223Python

openlake-project/openlake

6.9

Hyper efficient storage for GPU workloads. Feed your GPUs at blazing fast speeds.

★ 2.6k◇ 429Rust

AI-Hypercomputer/maxtext

7.2

A simple, performant and scalable Jax LLM!

★ 2.4k◇ 628Python

adithya-s-k/AI-Engineering.academy

5.6

Mastering Applied AI, One Concept at a Time

★ 2.4k◇ 286Jupyter Notebook

kubeflow/trainer

7.6

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

★ 2.2k◇ 1.1kGo

MoonshotAI/MoBA

4.6

MoBA: Mixture of Block Attention for Long-Context LLMs

★ 2.2k◇ 161Python

eosphoros-ai/DB-GPT-Hub

5.2

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

★ 2.0k◇ 249Python

THUDM/LongWriter

4.7

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

★ 1.9k◇ 185Python