Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Unsloth — a leading open-source project in the AI/LLM ecosystem.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

Go ahead and axolotl questions

Low-code framework for building custom LLMs, neural networks, and other AI models

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Efficient Triton Kernels for LLM Training

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Just talk to your agent — it learns and EVOLVES.

LLM Finetuning with peft

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

A simple, performant and scalable Jax LLM!

Mastering Applied AI, One Concept at a Time

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

MoBA: Mixture of Block Attention for Long-Context LLMs

Hyper efficient storage for GPU workloads. Feed your GPUs at blazing fast speeds.

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Ultrafast serverless GPU inference, sandboxes, and background jobs

Synthetic data curation for post-training and structured data extraction

DLRover: An Automatic Distributed Deep Learning System

Scalable data pre processing and curation toolkit for LLMs

Jackrong-llm-finetuning-guide — open-source AI/LLM project.

Nvidia GPU exporter for prometheus using nvidia-smi binary

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Framework for enhancing LLMs for RAG tasks using fine-tuning.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

LLM (Large Language Model) FineTuning

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

irresponsible innovation. Try now at https://chat.dev/

Repo for fine-tuning Casual LLMs

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.