Data-Driven Evaluation for LLM-Powered Applications

irresponsible innovation. Try now at https://chat.dev/

A fast and minimal framework for building agentic systems

Repo for fine-tuning Casual LLMs

The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.

A transparent, minimal, and hackable agent framework. ~300 lines of readable code. Full control, no magic.

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

xFasterTransformer — open-source AI/LLM project.

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

A REST API for Caffe using Docker and Go

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

A curated collection of resources for 🌌 Azure OpenAI, 🦙 LLMs (RAG, Agents).

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

A Production-Ready Framework for Building Composable AI Agents

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

A list of LLMs Tools & Projects

A very fast, very minimal prompt optimizer

Python SDK for running evaluations on LLM generated responses

LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework

Work with LLMs on a local environment using containers

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.

电子鹦鹉 / Toy Language Model

Make your OpenClaw AI agent faster, smarter, and cheaper. Speed optimization, memory architecture, context management, model selection, and one-shot development guide.

Autonomous AI agent that contributes to open source — discovers repos, analyzes code, generates fixes, and submits PRs

Action library for AI Agent

This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.

PocketGroq is a powerful Python library that simplifies integration with the Groq API, offering advanced features for natural language processing, web scraping, and autonomous agent capabilities. Key Features Seamless integration with Groq API for text generation and completion Chain of Thought (CoT) reasoning for complex problem-solving and more.

可同时输入多个初版提示词，开启多轮自动优化，连续得到高分后得到最终结果。

AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.

A unified, modular Framework for Prompt Optimization

Claude Code skill that transforms vague prompts into structured, expert-level prompts using 7 research-backed frameworks (CO-STAR, RISEN, RISE, TIDD-EC, RTF, CoT, CoD)

QA Skills Directory QA Skills is a curated directory of testing-specific skills for AI coding agents (Claude Code, Cursor, Copilot, etc.).

SkillFoundry — a leading open-source project in the AI/LLM ecosystem.

StackQuadrant — a leading open-source project in the AI/LLM ecosystem.