STACKQUADRANT

MoBA

MoonshotAI/MoBA
4.6

MoBA: Mixture of Block Attention for Long-Context LLMs

Fine-tuning Tools
2.1k141PythonMIT1y ago

trainer

kubeflow/trainer
7.5

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

Fine-tuning Tools
2.1k945GoApache-2.0today

llama_deploy

run-llama/llama_deploy
6.9

Deploy your agentic worfklows to production

LLM Frameworks
2.1k229PythonMIT14d ago

aici

microsoft/aici
4.9

AICI: Prompts as (Wasm) Programs

Model Serving
2.1k83RustMIT1y ago

DB-GPT-Hub

eosphoros-ai/DB-GPT-Hub
5.3

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

Fine-tuning Tools
2.0k246PythonMIT9mo ago

beelzebub

mariocandela/beelzebub
6.8

A secure low code honeypot framework, leveraging AI for System Virtualization.

LLM Frameworks
2.0k186GoGPL-3.01d ago

beelzebub

beelzebub-labs/beelzebub
6.8

A secure low code honeypot framework, leveraging AI for System Virtualization.

LLM Frameworks
2.0k186GoGPL-3.01d ago

vllm-ascend

vllm-project/vllm-ascend
7.1

Community maintained hardware plugin for vLLM on Ascend

Model Serving
2.0k1.1kC++Apache-2.0today

LongWriter

THUDM/LongWriter
4.7

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

Fine-tuning Tools
1.9k184PythonApache-2.010mo ago

agentic_security

msoedov/agentic_security
6.2

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

Agent Frameworks
1.8k244PythonApache-2.02mo ago

verl-agent

langfengQ/verl-agent
6.8

verl-agent is an extension of veRL, designed for training LLM/VLM agents via RL. verl-agent is also the official code for paper "Group-in-Group Policy Optimization for LLM Agent Training"

Agent Frameworks
1.8k175PythonApache-2.01mo ago

Awesome-Embodied-Robotics-and-Agent

zchoi/Awesome-Embodied-Robotics-and-Agent
5.9

This is a curated list of "Embodied AI or robot with Large Language Models" research. Watch this repository for the latest updates! 🔥

LLM Frameworks
1.8k92Apache-2.01d ago

py-gpt

szczyglis-dev/py-gpt
6.1

Desktop AI Assistant powered by GPT-5, GPT-4, o1, o3, Gemini, Claude, Ollama, DeepSeek, Perplexity, Grok, Bielik, chat, vision, voice, RAG, image and video generation, agents, tools, MCP, plugins, speech synthesis and recognition, web search, memory, presets, assistants,and more. Linux, Windows, Mac

Agent Frameworks
1.7k320PythonNOASSERTION2mo ago

DATAGEN

starpig1129/DATAGEN
5.5

DATAGEN: AI-driven multi-agent research assistant automating hypothesis generation, data analysis, and report writing.

LLM Frameworks
1.7k226PythonMIT2d ago

curator

bespokelabsai/curator
6.6

Synthetic data curation for post-training and structured data extraction

Fine-tuning Tools
1.7k137PythonApache-2.02d ago

mlrun

mlrun/mlrun
7.2

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

Model Serving
1.7k303PythonApache-2.0today

raptor

parthsarthi03/raptor
5.0

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

LLM Frameworks
1.6k219PythonMIT1y ago

dlrover

intelligent-machine-learning/dlrover
6.5

DLRover: An Automatic Distributed Deep Learning System

Fine-tuning Tools
1.6k212PythonNOASSERTION6d ago

beta9

beam-cloud/beta9
6.5

Ultrafast serverless GPU inference, sandboxes, and background jobs

Fine-tuning Tools
1.6k142GoAGPL-3.026d ago

aisheets

huggingface/aisheets
6.2

Build, enrich, and transform datasets using AI models with no code

Evaluation & Testing
1.6k138TypeScriptApache-2.012d ago

Seed1.5-VL

ByteDance-Seed/Seed1.5-VL
4.9

Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving state-of-the-art performance on 38 out of 60 public benchmarks.

LLM Frameworks
1.6k65Jupyter NotebookApache-2.010mo ago

Agently

AgentEra/Agently
7.1

[GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with GenAI agent in code using structure data and chained-calls syntax 🧩 Use Event-Driven Flow *TriggerFlow* to manage complex GenAI working logic 🔀 Switch to any model without rewrite application code

Agent Frameworks
1.5k172PythonApache-2.0today

Curator

NVIDIA-NeMo/Curator
6.2

Scalable data pre processing and curation toolkit for LLMs

Fine-tuning Tools
1.5k258PythonApache-2.0today

better-agents

langwatch/better-agents
6.0

Standards for building agents, better

Agent Frameworks
1.5k149TypeScriptMIT1mo ago

MiniOneRec

AkaliKong/MiniOneRec
5.3

Minimal reproduction of OneRec

LLM Frameworks
1.5k208PythonApache-2.021d ago

nvidia_gpu_exporter

utkuozdemir/nvidia_gpu_exporter
5.9

Nvidia GPU exporter for prometheus using nvidia-smi binary

Fine-tuning Tools
1.5k147GoMIT2d ago

awesome-japanese-llm

llm-jp/awesome-japanese-llm
6.2

日本語LLMまとめ - Overview of Japanese LLMs

LLM Frameworks
1.4k44TypeScriptApache-2.05d ago

Director

video-db/Director
6.0

AI video agents framework for next-gen video interactions and workflows.

LLM Frameworks
1.4k223PythonMIT2mo ago

FuzzyAI

cyberark/FuzzyAI
5.6

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

Evaluation & Testing
1.3k189Jupyter NotebookApache-2.02mo ago

kitops

kitops-ml/kitops
6.9

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Model Serving
1.3k174GoApache-2.0today

home-llm

acon96/home-llm
5.8

A Home Assistant integration & Model to control your smart home using a Local LLM

LLM Frameworks
1.3k133Python8d ago

hopsworks

logicalclocks/hopsworks
5.8

Hopsworks - Data-Intensive AI platform with a Feature Store

Model Serving
1.3k156JavaAGPL-3.01y ago

Awesome-Knowledge-Distillation-of-LLMs

Tebmer/Awesome-Knowledge-Distillation-of-LLMs
3.9

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

LLM Frameworks
1.3k721y ago

text-to-lora

SakanaAI/text-to-lora
5.0

Hypernetworks that adapt LLMs for specific benchmark tasks using only textual task description as the input

Fine-tuning Tools
1.3k87PythonApache-2.010mo ago

sre

SmythOS/sre
6.4

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

Agent Frameworks
1.3k192TypeScriptMIT18d ago

prompty

microsoft/prompty
6.8

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

Evaluation & Testing
1.2k114TypeScriptMIT2d ago

AWorld

inclusionAI/AWorld
6.7

Build, evaluate and train General Multi-Agent Assistance with ease

Agent Frameworks
1.2k122PythonMITtoday

mlx-tune

ARahim3/mlx-tune
5.5

Bringing the Unsloth experience to Mac users via Apple's MLX framework

Fine-tuning Tools
1.2k76PythonApache-2.01d ago

awesome-ai-sdks

e2b-dev/awesome-ai-sdks
3.8

A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents

LLM Frameworks
1.2k2011y ago

agent-governance-toolkit

microsoft/agent-governance-toolkit
6.5

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Agent Frameworks
1.1k214PythonMITtoday

uqlm

cvs-health/uqlm
6.7

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Evaluation & Testing
1.1k120PythonApache-2.04d ago

truss

basetenlabs/truss
6.7

The simplest way to serve AI/ML models in production

Model Serving
1.1k100PythonMITtoday

full-stack-ai-agent-template

vstorm-co/full-stack-ai-agent-template
6.3

Full-stack AI app generator — FastAPI + Next.js with agents, RAG, streaming, auth, and 20+ integrations out of the box.

Agent Frameworks
1.1k228PythonMITtoday

DataDreamer

datadreamer-dev/DataDreamer
4.9

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models.   🤖💤

Fine-tuning Tools
1.1k59PythonMIT1y ago

rtp-llm

alibaba/rtp-llm
6.1

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Model Serving
1.1k175CudaApache-2.0today

ai-engineering-interview-questions

amitshekhariitbhu/ai-engineering-interview-questions
5.6

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Fine-tuning Tools
1.1k198MarkdownApache-2.01d ago

agents

inkeep/agents
6.3

Create AI Agents in a No-Code Visual Builder or TypeScript SDK with full 2-way sync. For shipping AI assistants and multi-agent AI workflows.

Agent Frameworks
1.1k128TypeScriptNOASSERTIONtoday

SLAM-LLM

X-LANCE/SLAM-LLM
5.7

A Framework for Speech, Language, Audio, Music Processing with Large Language Model

LLM Frameworks
1.0k112PythonMIT3mo ago