Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Unsloth — a leading open-source project in the AI/LLM ecosystem.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

Go ahead and axolotl questions

Low-code framework for building custom LLMs, neural networks, and other AI models

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Efficient Triton Kernels for LLM Training

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Just talk to your agent — it learns and EVOLVES.

LLM Finetuning with peft

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

A simple, performant and scalable Jax LLM!

Mastering Applied AI, One Concept at a Time

MoBA: Mixture of Block Attention for Long-Context LLMs

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Synthetic data curation for post-training and structured data extraction

DLRover: An Automatic Distributed Deep Learning System

Ultrafast serverless GPU inference, sandboxes, and background jobs

Scalable data pre processing and curation toolkit for LLMs

Nvidia GPU exporter for prometheus using nvidia-smi binary

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Framework for enhancing LLMs for RAG tasks using fine-tuning.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

LLM (Large Language Model) FineTuning

irresponsible innovation. Try now at https://chat.dev/

Repo for fine-tuning Casual LLMs

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention