Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root cause.

Open-source autonomous AI agent — runs on Claude-web, Gemini-web, Kimi-web, Deepseek-web and more for free and Every paid model via liteLLM. No API key required.

Make your OpenClaw AI agent faster, smarter, and cheaper. Speed optimization, memory architecture, context management, model selection, and one-shot development guide.

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

A comprehensive set of LLM benchmark scores and provider prices. (deprecated, read more in README)

A Production-Ready Framework for Building Composable AI Agents

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)

A CLI tool for logging and analyzing Claude Code and Cursor ai-driven coding session.

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).

AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf, Copilot. Test Flutter, React Native, iOS, Android, Web, Electron, Tauri, KMP, .NET MAUI — all from natural language.

A list of LLMs Tools & Projects

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

Python SDK for running evaluations on LLM generated responses

A very fast, very minimal prompt optimizer

Work with LLMs on a local environment using containers

电子鹦鹉 / Toy Language Model

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.

Autonomous prediction market trading agent | Wang Transform pricing engine calibrated on 291K+ contracts | Kalshi · Polymarket · Solana DFlow · Jito bundles · 633 tests

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuning (AI Tune), hardware-matched HuggingFace downloads, and crash recovery. An Ollama alternative for multi-GPU rigs.

Claude Code skill that transforms vague prompts into structured, expert-level prompts using 7 research-backed frameworks (CO-STAR, RISEN, RISE, TIDD-EC, RTF, CoT, CoD)

Autonomous AI agent that contributes to open source — discovers repos, analyzes code, generates fixes, and submits PRs

Computer-Use SDK for E2E QA Testing

Action library for AI Agent

This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.

PocketGroq is a powerful Python library that simplifies integration with the Groq API, offering advanced features for natural language processing, web scraping, and autonomous agent capabilities. Key Features Seamless integration with Groq API for text generation and completion Chain of Thought (CoT) reasoning for complex problem-solving and more.

可同时输入多个初版提示词，开启多轮自动优化，连续得到高分后得到最终结果。

QA Skills Directory QA Skills is a curated directory of testing-specific skills for AI coding agents (Claude Code, Cursor, Copilot, etc.).

Open survey and evidence map for AI agent evolution, self-evolving agents, memory, skills, harnesses, benchmarks, and agent-swarm systems.

The self-improving Agentic QA harness with Memory. Write tests in natural language.
 Catch regressions before releases ship.

Best Prompt Engineering Tools for 2026 AI Workflow Optimization

Top 10 Claude Prompt Optimization Frameworks 2026

Finish-First Autonomous Agent Loop for Claude Opus 4.7 – 2026 Edition

A unified, modular framework for prompt optimization

A unified, modular Framework for Prompt Optimization

MCP server for AI image generation and editing with automatic prompt optimization and quality presets (fast/balanced/quality). Powered by Gemini (Nano Banana 2 & Pro).

Collection of Claude Skills for DSPy framework - program language models, optimize prompts, and build RAG pipelines systematically

Open-source, bilingual AI video-prompt skill — rewrite ideas into model-ready text-to-video prompts. A portable Agent Skill (Claude Code, Codex, OpenClaw, Hermes); generate via Atlas Cloud — Seedance 2.0, Kling, Veo, Hailuo, Wan, Vidu, Gemini Omni, Grok Imagine.

AI接口自动化测试 Skill：面向 Python + pytest + requests，驱动 Codex / Claude Code 生成、维护和调试接口用例（AI API test automation skill for Python + pytest + requests）

Spec2Case 是生产级 AI 测试用例生成智能体，支持图片/文本需求理解、人工确认、LangGraph 流程编排和 Excel 用例导出。

SkillFoundry — a leading open-source project in the AI/LLM ecosystem.

StackQuadrant — a leading open-source project in the AI/LLM ecosystem.