Unsloth — a leading open-source project in the AI/LLM ecosystem.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

Go ahead and axolotl questions

Low-code framework for building custom LLMs, neural networks, and other AI models

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Efficient Triton Kernels for LLM Training

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Just talk to your agent — it learns and EVOLVES.

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

LLM Finetuning with peft

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Hyper efficient storage for GPU workloads. Feed your GPUs at blazing fast speeds.

A simple, performant and scalable Jax LLM!

Mastering Applied AI, One Concept at a Time

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

MoBA: Mixture of Block Attention for Long-Context LLMs

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Ultrafast serverless GPU inference, sandboxes, and background jobs

Scalable data pre processing and curation toolkit for LLMs

Synthetic data curation for post-training and structured data extraction

Jackrong-llm-finetuning-guide — open-source AI/LLM project.

DLRover: An Automatic Distributed Deep Learning System

Nvidia GPU exporter for prometheus using nvidia-smi binary

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Framework for enhancing LLMs for RAG tasks using fine-tuning.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

LLM (Large Language Model) FineTuning

irresponsible innovation. Try now at https://chat.dev/

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.