STACKQUADRANT

home-llm

acon96/home-llm
5.9

A Home Assistant integration & Model to control your smart home using a Local LLM

LLM Frameworks
1.4k140Python14d ago

kitops

kitops-ml/kitops
7.0

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Model Serving
1.4k180GoApache-2.0today

mlx-tune

ARahim3/mlx-tune
5.6

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Fine-tuning Tools
1.4k88PythonApache-2.027d ago

agents

inkeep/agents
6.7

Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For shipping AI assistants and multi-agent AI workflows.

Agent Frameworks
1.3k152TypeScriptNOASSERTIONtoday

hopsworks

logicalclocks/hopsworks
5.8

Hopsworks - Data-Intensive AI platform with a Feature Store

Model Serving
1.3k158JavaAGPL-3.01y ago

text-to-lora

SakanaAI/text-to-lora
5.0

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

Fine-tuning Tools
1.3k88PythonApache-2.01y ago

Awesome-Knowledge-Distillation-of-LLMs

Tebmer/Awesome-Knowledge-Distillation-of-LLMs
3.9

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

LLM Frameworks
1.3k721y ago

sre

SmythOS/sre
6.2

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

Agent Frameworks
1.3k197TypeScriptMIT3mo ago

rtp-llm

alibaba/rtp-llm
6.2

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Model Serving
1.3k241CudaApache-2.0today

NeuroSploit

JoasASantos/NeuroSploit
5.7

NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).

LLM Frameworks
1.2k303Rust1d ago

NeuroSploit

CyberSecurityUP/NeuroSploit
5.7

NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations. Leveraging the capabilities of large language models (LLMs).

LLM Frameworks
1.2k303Rust1d ago

prompty

microsoft/prompty
6.9

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

Evaluation & Testing
1.2k119TypeScriptMITtoday

passmark

bug0inc/passmark
5.9

The open-source Playwright library for AI browser regression testing with intelligent caching, auto-healing, and multi-model verification.

Evaluation & Testing
1.2k183TypeScriptNOASSERTION11d ago

AWorld

inclusionAI/AWorld
6.8

Build, evaluate and train General Multi-Agent Assistance with ease

Agent Frameworks
1.2k124PythonMITtoday

awesome-ai-sdks

e2b-dev/awesome-ai-sdks
4.7

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

LLM Frameworks
1.2k32411d ago

skales

skalesapp/skales
6.3

Free AI Desktop Agent for Windows, macOS & Linux - Automate email, calendar, browser, code generation. 13+ AI providers, Ollama, Telegram remote control. No Docker, no terminal. 🦎

Agent Frameworks
1.2k185TypeScriptNOASSERTIONtoday

uqlm

cvs-health/uqlm
6.7

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Evaluation & Testing
1.2k127PythonApache-2.011d ago

truss

basetenlabs/truss
6.9

The simplest way to serve AI/ML models in production

Model Serving
1.2k115PythonMITtoday

auto-re-agent

Dryxio/auto-re-agent
5.6

Open-source AI reverse-engineering agent using Ghidra and LLMs to reconstruct and validate C/C++ functions from binaries.

Agent Frameworks
1.1k139PythonMIT1d ago

DataDreamer

datadreamer-dev/DataDreamer
4.9

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Fine-tuning Tools
1.1k59PythonMIT1y ago

kvcached

ovg-project/kvcached
5.9

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Inference Engines
1.1k124PythonApache-2.0today

Hexabot

Hexastack/Hexabot
6.3

Hexabot v3 is an automation platform with first-class AI capabilities, combining workflows, actions, and conversational channels in one runtime.

LLM Frameworks
1.1k222TypeScriptNOASSERTIONtoday

Hexabot

hexabot-ai/Hexabot
6.3

Hexabot v3 is an AI automation platform, combining workflows, actions, agents, and conversational channels in one runtime.

LLM Frameworks
1.1k222TypeScriptNOASSERTIONtoday

cashclaw

moltlaunch/cashclaw
5.2

An autonomous agent that takes work, does work, gets paid, and gets better at it.

Agent Frameworks
1.1k215TypeScriptMIT4mo ago

GraphGen

InternScience/GraphGen
6.0

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Fine-tuning Tools
1.1k81PythonApache-2.02mo ago

SLAM-LLM

X-LANCE/SLAM-LLM
5.5

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

LLM Frameworks
1.0k117PythonMIT6mo ago

judgeval

JudgmentLabs/judgeval
6.6

The open source post-building layer for agents. Our environment data and evals power agent post-training (RL, SFT) and monitoring.

Evaluation & Testing
1.0k94PythonApache-2.01d ago

nobodywho

nobodywho-ooo/nobodywho
6.4

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Inference Engines
1.0k72RustEUPL-1.2today

veScale

volcengine/veScale
5.2

Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs

Fine-tuning Tools
1.0k64PythonApache-2.04mo ago

FinSight-AI

juanjuandog/FinSight-AI
5.0

AI equity research agent with resilient workflows, Redis Lua single-flight, pgvector RAG, versioned reports, evidence tracing, and RAG evaluation.

Evaluation & Testing
1.0k53JavaMIT1mo ago

pydantic-deepagents

vstorm-co/pydantic-deepagents
6.7

Python Deep Agent framework built on top of Pydantic-AI, designed to help you quickly build production-grade autonomous AI agents with planning, filesystem operations, subagent delegation, skills, and structured outputs—in just 10 lines of code.

Agent Frameworks
984114PythonMITtoday

start-llms

louisfb01/start-llms
5.2

A complete guide to start and improve your LLM skills in 2026 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Fine-tuning Tools
980128MIT5mo ago

Nanoflow

efeslab/Nanoflow
4.6

A throughput-oriented high-performance serving framework for LLMs

Model Serving
96850Jupyter Notebook3mo ago

WHartTest

MGdaasLab/WHartTest
6.3

WHartTest 是一款AI驱动的测试自动化平台,实现从需求到可执行测试用例的自动化生成与管理,帮助测试团队提升效率与覆盖率。 (WHartTest is an AI-driven test automation platform that automates the generation and management of executable test cases from requirements, helping testing teams improve efficiency and coverage.)

Evaluation & Testing
962143PythonMIT4d ago

mcp-framework

QuantGeekDev/mcp-framework
6.1

The Typescript MCP Framework

LLM Frameworks
930114TypeScriptMIT3mo ago

scenario

langwatch/scenario
6.2

Agentic testing for agentic codebases

Evaluation & Testing
92167PythonMITtoday

mlxstudio

jjang-ai/mlxstudio
5.5

MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

Inference Engines
91162today

ZhiLight

zhihu/ZhiLight
5.2

A highly optimized LLM inference acceleration engine for Llama and its variants.

Inference Engines
905103C++Apache-2.04mo ago

mosec

mosecorg/mosec
6.5

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

Model Serving
90473PythonApache-2.010d ago

model_server

openvinotoolkit/model_server
6.6

A scalable inference server for models optimized with OpenVINO™

Model Serving
903261C++Apache-2.0today

open-claude-tag

Anil-matcha/open-claude-tag
5.5

Self-hostable channel-native AI teammate for Slack. Open source alternative to Claude Tag. LLM-agnostic.

Agent Frameworks
888190PythonMIT25d ago

cerebellum

theredsix/cerebellum
5.0

Browser automation system that uses AI-driven planning to navigate web pages and perform goals.

Fine-tuning Tools
86457PythonMIT1mo ago

AI-Compass

tingaicompass/AI-Compass
5.6

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。

Fine-tuning Tools
864115Python1d ago

Foundry

promptise-com/Foundry
6.0

The foundation layer for agentic intelligence.

Agent Frameworks
858128PythonApache-2.03d ago

DeepMCPAgent

cryxnet/DeepMCPAgent
6.1

Model-agnostic plug-n-play LangChain/LangGraph agents powered entirely by MCP tools over HTTP/SSE.

Agent Frameworks
858128PythonApache-2.03d ago

pipeless

pipeless-ai/pipeless
5.0

An open-source computer vision framework to build and deploy apps in minutes

Model Serving
85152RustApache-2.02y ago

Yatai

bentoml/Yatai
6.1

Model Deployment at Scale on Kubernetes 🦄️

Model Serving
84376TypeScriptNOASSERTION1mo ago

Adan

sail-sg/Adan
4.4

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Fine-tuning Tools
81970PythonApache-2.01y ago