Fine-tuning Tools

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Unsloth — a leading open-source project in the AI/LLM ecosystem.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

Go ahead and axolotl questions

Low-code framework for building custom LLMs, neural networks, and other AI models

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Efficient Triton Kernels for LLM Training

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Just talk to your agent — it learns and EVOLVES.

LLM Finetuning with peft

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

A simple, performant and scalable Jax LLM!

Mastering Applied AI, One Concept at a Time

MoBA: Mixture of Block Attention for Long-Context LLMs

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Synthetic data curation for post-training and structured data extraction

DLRover: An Automatic Distributed Deep Learning System

Ultrafast serverless GPU inference, sandboxes, and background jobs