STACKQUADRANT

GraphGen

InternScience/GraphGen
6.2

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Fine-tuning Tools
★ 1.2k◇ 100PythonApache-2.02mo ago

awesome-ai-sdks

e2b-dev/awesome-ai-sdks
4.4

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

LLM Frameworks
★ 1.2k◇ 4163mo ago

cashclaw

moltlaunch/cashclaw
5.2

An autonomous agent that takes work, does work, gets paid, and gets better at it.

Agent Frameworks
★ 1.2k◇ 228TypeScriptMIT7mo ago

truss

basetenlabs/truss
7.2

The simplest way to serve AI/ML models in production

Model Serving
★ 1.2k◇ 134PythonMIT1d ago

uqlm

cvs-health/uqlm
6.7

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Evaluation & Testing
★ 1.2k◇ 136PythonApache-2.04d ago

Hexabot

Hexastack/Hexabot
6.3

Hexabot v3 is an automation platform with first-class AI capabilities, combining workflows, actions, and conversational channels in one runtime.

LLM Frameworks
★ 1.2k◇ 239TypeScriptNOASSERTION24d ago

Hexabot

hexabot-ai/Hexabot
6.3

Hexabot v3 is an AI automation platform, combining workflows, actions, agents, and conversational channels in one runtime.

LLM Frameworks
★ 1.2k◇ 239TypeScriptNOASSERTION24d ago

TurboOCR

aiptimizer/TurboOCR
6.0

Fast GPU OCR server. 270 img/s on FUNSD. TensorRT FP16, PP-OCRv5, HTTP + gRPC.

Model Serving
★ 1.1k◇ 115C++MIT20d ago

DataDreamer

datadreamer-dev/DataDreamer
4.9

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Fine-tuning Tools
★ 1.1k◇ 59PythonMIT1y ago

pydantic-deepagents

vstorm-co/pydantic-deepagents
6.8

Python Deep Agent framework built on top of Pydantic-AI, designed to help you quickly build production-grade autonomous AI agents with planning, filesystem operations, subagent delegation, skills, and structured outputs—in just 10 lines of code.

Agent Frameworks
★ 1.1k◇ 139PythonMIT11d ago

judgeval

JudgmentLabs/judgeval
6.6

The open source post-building layer for agents. Our environment data and evals power agent post-training (RL, SFT) and monitoring.

Evaluation & Testing
★ 1.1k◇ 103PythonApache-2.0today

SLAM-LLM

X-LANCE/SLAM-LLM
5.3

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

LLM Frameworks
★ 1.1k◇ 119PythonMIT9mo ago

WHartTest

MGdaasLab/WHartTest
6.6

WHartTest 是一款AI驱动的测试自动化平台,实现从需求到可执行测试用例的自动化生成与管理,帮助测试团队提升效率与覆盖率。 (WHartTest is an AI-driven test automation platform that automates the generation and management of executable test cases from requirements, helping testing teams improve efficiency and coverage.)

Evaluation & Testing
★ 1.1k◇ 172PythonMIT2d ago

veScale

volcengine/veScale
5.0

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

Fine-tuning Tools
★ 1.0k◇ 66PythonApache-2.07mo ago

scenario

langwatch/scenario
6.1

Agentic testing for agentic codebases

Evaluation & Testing
★ 993◇ 88TypeScriptMIT3d ago

awesome-evals

benchflow-ai/awesome-evals
5.0

A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.

Evaluation & Testing
★ 987◇ 131NOASSERTIONtoday

mlxstudio

jjang-ai/mlxstudio
5.5

MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

Inference Engines
★ 986◇ 663d ago

start-llms

louisfb01/start-llms
5.1

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Fine-tuning Tools
★ 984◇ 136MIT8mo ago

AI-Compass

tingaicompass/AI-Compass
5.6

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。

Fine-tuning Tools
★ 983◇ 128Python24d ago

aimock

CopilotKit/aimock
6.6

Mock everything your AI app talks to — LLM APIs, MCP, A2A, vector DBs, search. One package, one port, zero dependencies.

Evaluation & Testing
★ 979◇ 84TypeScriptMITtoday

Nanoflow

efeslab/Nanoflow
4.5

A throughput-oriented high-performance serving framework for LLMs

Model Serving
★ 976◇ 54Jupyter Notebook6mo ago

model_server

openvinotoolkit/model_server
6.9

A scalable inference server for models optimized with OpenVINO™

Model Serving
★ 948◇ 283C++Apache-2.01d ago

mcp-framework

QuantGeekDev/mcp-framework
5.8

The Typescript MCP Framework

LLM Frameworks
★ 931◇ 116TypeScriptMIT6mo ago

agent-qa

vostride/agent-qa
5.5

The self-improving Agentic QA harness with Memory. Write tests in natural language.
 Catch regressions before releases ship.

Evaluation & Testing
★ 910◇ 22TypeScriptNOASSERTION2mo ago

ZhiLight

zhihu/ZhiLight
5.0

A highly optimized LLM inference acceleration engine for Llama and its variants.

Inference Engines
★ 907◇ 108C++Apache-2.07mo ago

mosec

mosecorg/mosec
6.7

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Model Serving
★ 902◇ 80PythonApache-2.05d ago

awesome-on-policy-distillation

chrisliu298/awesome-on-policy-distillation
4.7

A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models

Fine-tuning Tools
★ 886◇ 42CC0-1.011d ago

DeepMCPAgent

cryxnet/DeepMCPAgent
6.1

Model-agnostic plug-n-play LangChain/LangGraph agents powered entirely by MCP tools over HTTP/SSE.

Agent Frameworks
★ 874◇ 129PythonApache-2.0today

Foundry

promptise-com/Foundry
6.1

The foundation layer for agentic intelligence.

Agent Frameworks
★ 874◇ 129PythonApache-2.0today

cerebellum

theredsix/cerebellum
4.8

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Fine-tuning Tools
★ 865◇ 57PythonMIT4mo ago

pipeless

pipeless-ai/pipeless
5.0

An open-source computer vision framework to build and deploy apps in minutes

Model Serving
★ 855◇ 53RustApache-2.02y ago

awesome-ai-apps

rohitg00/awesome-ai-apps
4.8

A curated collection of awesome AI Agents and LLM Apps built with multiple tech stacks, showcasing real-world implementations using OpenAI, Gemini, local models, and various AI frameworks.

LLM Frameworks
★ 840◇ 180HTMLApache-2.08mo ago

Yatai

bentoml/Yatai
5.8

Model Deployment at Scale on Kubernetes 🦄️

Model Serving
★ 839◇ 76TypeScriptNOASSERTION4mo ago

Adan

sail-sg/Adan
4.4

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Fine-tuning Tools
★ 823◇ 73PythonApache-2.01y ago

blades

go-kratos/blades
6.0

Blades is a Go-based multimodal AI Agent framework.

Agent Frameworks
★ 816◇ 101GoMIT2mo ago

agent-skills-eval

darkrishabh/agent-skills-eval
5.5

A test runner for agentskills.io-style AI agent skills

Evaluation & Testing
★ 802◇ 45TypeScriptMIT3d ago

RAG-FiT

IntelLabs/RAG-FiT
5.8

Framework for enhancing LLMs for RAG tasks using fine-tuning.

Fine-tuning Tools
★ 766◇ 62PythonApache-2.02d ago

Trace

microsoft/Trace
5.7

End-to-end Generative Optimization for AI Agents

Prompt Engineering
★ 762◇ 63PythonMIT4mo ago

fakecloud

faiscadev/fakecloud
6.6

Free, open-source AWS emulator. LocalStack alternative: 26 services, 1,924 operations, 100% conformance. No account, no auth token, no paid tier.

Evaluation & Testing
★ 756◇ 53RustAGPL-3.0today

voice-ai

rapidaai/voice-ai
6.4

Rapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.

Agent Frameworks
★ 747◇ 123GoNOASSERTIONtoday

LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing

ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
4.8

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

Fine-tuning Tools
★ 734◇ 124Jupyter NotebookMIT7mo ago

openinfer

openinfer-project/openinfer
6.6

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Inference Engines
★ 724◇ 117RustApache-2.0today

pegainfer

pegainfer-project/pegainfer
6.6

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Inference Engines
★ 724◇ 117RustApache-2.0today

ServerlessLLM

ServerlessLLM/ServerlessLLM
5.7

Serverless LLM Serving for Everyone.

Model Serving
★ 718◇ 78PythonApache-2.01mo ago

gitagent

open-gitagent/gitagent
5.9

A framework-agnostic, git-native standard for defining AI agents

Agent Frameworks
★ 717◇ 136RustMIT2d ago

long-context-attention

feifeibear/long-context-attention
5.7

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

Fine-tuning Tools
★ 696◇ 87PythonApache-2.01mo ago

timber

kossisoroyce/timber
5.0

Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster than Python inference.

Model Serving
★ 689◇ 23PythonNOASSERTION6mo ago

gollm

teilomillet/gollm
5.6

Unified Go interface for Language Model (LLM) providers. Simplifies LLM integration with flexible prompt management and common task functions.

Prompt Engineering
★ 676◇ 67GoApache-2.07mo ago