STACKQUADRANT

presenton

presenton/presenton
6.7

Open-Source AI Presentation Generator and API (Gamma, Beautiful AI, Decktopus Alternative)

Agent Frameworks
4.7k920TypeScriptApache-2.0today

cactus

cactus-compute/cactus
7.1

Low-latency AI engine for mobile devices & wearables

LLM Frameworks
4.6k357CNOASSERTIONtoday

Integuru

Integuru-AI/Integuru
6.4

The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.

Agent Frameworks
4.6k357PythonAGPL-3.01d ago

youtu-agent

TencentCloudADP/youtu-agent
6.7

A simple yet powerful agent framework that delivers with open-source models

Agent Frameworks
4.5k463PythonNOASSERTION24d ago

infinity

infiniflow/infinity
7.3

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Vector Databases
4.5k415C++Apache-2.012d ago

cognita

truefoundry/cognita
6.9

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

LLM Frameworks
4.4k389PythonApache-2.01mo ago

ag2

ag2ai/ag2
7.7

AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/sNGSwQME3x

Agent Frameworks
4.4k584PythonApache-2.0today

crate

crate/crate
7.8

CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene.

Vector Databases
4.4k594JavaApache-2.0today

Deep-Learning-in-Production

ahkarami/Deep-Learning-in-Production
4.5

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

Model Serving
4.4k6921y ago

Olares

beclab/Olares
7.0

Olares: An Open-Source Personal Cloud to Reclaim Your Data

Model Serving
4.3k244GoAGPL-3.0today

inkos

Narcooo/inkos
6.2

Autonomous novel writing CLI AI Agent — agents write, audit, and revise novels with human review gates

Agent Frameworks
4.3k828TypeScriptAGPL-3.0today

local-deep-research

LearningCircuit/local-deep-research
6.7

Local Deep Research achieves ~95% on SimpleQA benchmark (tested with GPT-4.1-mini). Supports local and cloud LLMs (Ollama, Google, Anthropic, ...). Searches 10+ sources - arXiv, PubMed, web, and your private documents. Everything Local & Encrypted.

RAG Libraries
4.3k410PythonMITtoday

vllm-omni

vllm-project/vllm-omni
7.2

A framework for efficient model inference with omni-modality models

Model Serving
4.3k757PythonApache-2.0today

Bindu

GetBindu/Bindu
7.0

Bindu: Turn any AI agent into a living microservice - interoperable, observable, composable.

Agent Frameworks
4.2k345PythonNOASSERTION1d ago

AdalFlow

SylphAI-Inc/AdalFlow
7.0

AdalFlow: The library to build & auto-optimize LLM applications.

LLM Frameworks
4.1k367PythonMIT1mo ago

tiny-llm

skyzh/tiny-llm
6.8

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

LLM Frameworks
4.1k306PythonApache-2.02d ago

bRAG-langchain

bragai/bRAG-langchain
5.6

Everything you need to know to build your own RAG application

RAG Libraries
4.1k486Jupyter NotebookNOASSERTION4mo ago

helix-db

HelixDB/helix-db
7.0

HelixDB is an open-source graph-vector database built from scratch in Rust.

Vector Databases
4.1k215RustAGPL-3.01d ago

USearch

unum-cloud/USearch
7.3

Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

Vector Databases
4.0k308C++Apache-2.0today

FedML

FedML-AI/FedML
6.8

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Agent Frameworks
4.0k768PythonApache-2.05mo ago

agenta

Agenta-AI/agenta
7.7

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Evaluation & Testing
4.0k508TypeScriptNOASSERTIONtoday

lmms-eval

EvolvingLMMs-Lab/lmms-eval
7.5

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Evaluation & Testing
4.0k560PythonNOASSERTION2d ago

LightLLM

ModelTC/LightLLM
6.5

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Model Serving
4.0k319PythonApache-2.0today

shimmy

Michael-A-Kuykendall/shimmy
6.2

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

Inference Engines
4.0k343RustApache-2.020d ago

langroid

langroid/langroid
7.2

Harness LLMs with Multi-Agent Programming

RAG Libraries
4.0k368PythonMIT8d ago

ravendb

ravendb/ravendb
8.0

ACID Document Database

Vector Databases
3.9k859C#NOASSERTIONtoday

claude-code-guide

zebbern/claude-code-guide
5.6

Claude Code Guide - Setup, Commands, workflows, agents, skills & tips-n-tricks

Agent Frameworks
3.9k375MITtoday

GenerativeAIExamples

NVIDIA/GenerativeAIExamples
6.6

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

RAG Libraries
3.9k1.0kJupyter NotebookApache-2.015d ago

memgraph

memgraph/memgraph
6.9

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

Agent Frameworks
3.9k217C++NOASSERTIONtoday

awesome-vibe-coding

filipecalegario/awesome-vibe-coding
6.1

A curated list of vibe coding references, collaborating with AI to write code.

Agent Frameworks
3.9k451CC0-1.04d ago

AI-Infra-from-Zero-to-Hero

HuaizhengZhang/AI-Infra-from-Zero-to-Hero
6.3

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Model Serving
3.9k377MIT8mo ago

telegram-search

groupultra/telegram-search
7.1

🔍 导出并模糊搜索 Telegram 聊天记录 | Export and fuzzy search your Telegram chat history

Agent Frameworks
3.9k243TypeScriptAGPL-3.05d ago

anything_about_game

killop/anything_about_game
6.2

A wonderful list of Game Development resources.

Agent Frameworks
3.8k497Apache-2.07d ago

mini-swe-agent

SWE-agent/mini-swe-agent
7.2

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

Agent Frameworks
3.8k530PythonMIT1d ago

LazyLLM

LazyAGI/LazyLLM
7.3

Easiest and laziest way for building multi-agent LLMs applications.

LLM Frameworks
3.8k378PythonApache-2.0today

RuVector

ruvnet/RuVector
6.7

RuVector is a High Performance, Real-Time, Self-Learning, Vector Graph Neural Network, and Database built in Rust.

Inference Engines
3.8k464RustMITtoday

ruvector

ruvnet/ruvector
6.7

RuVector is a High Performance, Real-Time, Self-Learning, Vector Graph Neural Network, and Database built in Rust.

Inference Engines
3.8k464RustMITtoday

lorax

predibase/lorax
6.1

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Inference Engines
3.7k312PythonApache-2.010mo ago

fast-agent

evalstate/fast-agent
7.4

Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP Support

Agent Frameworks
3.7k404PythonApache-2.01d ago

semantic-router

vllm-project/semantic-router
7.3

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

Fine-tuning Tools
3.7k619GoApache-2.0today

OpenClawChineseTranslation

1186258278/OpenClawChineseTranslation
6.6

🦞 OpenClaw (Clawdbot/Moltbot) 汉化版 - 开源个人 AI 助手中文版 | Claude/ChatGPT LLM 接入 | WhatsApp/Telegram/Discord 多平台 | 每小时自动同步 | CLI + Dashboard 全中文 | 全流程搭建教程,以及排错指南!

Agent Frameworks
3.7k460JavaScriptNOASSERTIONtoday

jailbreak_llms

verazuo/jailbreak_llms
5.3

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

LLM Frameworks
3.6k318Jupyter NotebookMIT1y ago

lemonade

lemonade-sdk/lemonade
7.0

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Inference Engines
3.5k261C++Apache-2.0today

refact

smallcloudai/refact
6.9

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Agent Frameworks
3.5k308RustBSD-3-Clause28d ago

AIGC-Interview-Book

WeThinkIn/AIGC-Interview-Book
6.0

【三年面试五年模拟】AIGC算法工程师面试秘籍。涵盖AIGC、LLM大模型、传统深度学习、自动驾驶、AI Agent、机器学习、计算机视觉、自然语言处理、强化学习、大数据挖掘、具身智能、元宇宙、AGI等AI行业面试笔试干货经验与核心知识。

Agent Frameworks
3.5k384GPL-3.01d ago

textgrad

zou-group/textgrad
6.1

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.

Prompt Engineering
3.5k285PythonMIT8mo ago

AI-Infra-Guard

Tencent/AI-Infra-Guard
7.3

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Evaluation & Testing
3.5k345PythonApache-2.0today

FlashRAG

RUC-NLPIR/FlashRAG
7.0

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

RAG Libraries
3.5k297PythonMIT5d ago