A curated collection of awesome AI Agents and LLM Apps built with multiple tech stacks, showcasing real-world implementations using OpenAI, Gemini, local models, and various AI frameworks.

Blades is a Go-based multimodal AI Agent framework.

Framework for enhancing LLMs for RAG tasks using fine-tuning.

End-to-end Generative Optimization for AI Agents

A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

Rapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.

Serverless LLM Serving for Everyone.

Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

Mock everything your AI app talks to — LLM APIs, MCP, A2A, vector DBs, search. One package, one port, zero dependencies.

Awesome papers involving LLMs in Social Science.

The .NET library to build AI agents with 30+ built-in connectors.

A test runner for agentskills.io-style AI agent skills

A framework-agnostic, git-native standard for defining AI agents

Daydreams is a set of tools for building agents for commerce

FastAPI Skeleton App to serve machine learning models production-ready.

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

LLM (Large Language Model) FineTuning

Deliver safe & effective language models

Deliver safe & effective language models

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

The Linux OS for AI Agents — Persistent memory, autonomy, and time-awareness for any LLM. Own the state. Rent the intelligence.

Fast GPU OCR server. 270 img/s on FUNSD. TensorRT FP16, PP-OCRv5, HTTP + gRPC.

Data-Driven Evaluation for LLM-Powered Applications

irresponsible innovation. Try now at https://chat.dev/

A fast and minimal framework for building agentic systems

Free, open-source AWS emulator. LocalStack alternative: 26 services, 1,924 operations, 100% conformance. No account, no auth token, no paid tier.

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Repo for fine-tuning Casual LLMs

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

xFasterTransformer — open-source AI/LLM project.

A REST API for Caffe using Docker and Go

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

A curated collection of resources for 🌌 Azure OpenAI, 🦙 LLMs (RAG, Agents).

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework