A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括335个大模型，覆盖chatgpt、gpt-5.2、o4-mini、谷歌gemini-3-pro、Claude-4.5、文心ERNIE-X1.1、ERNIE-5.0-Thinking、qwen3-max、百川、讯飞星火、商汤senseChat等商用模型， 以及kimi-k2、ernie4.5、minimax-M2、deepseek-v3.2、qwen3-2507、llama4、智谱GLM-4.6、gemma3、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大模型缺陷库！方便广大社区研究分析、改进大模型。

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

Zero-Config Code Flow for Claude code & Codex

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Building AI agents, atomically

An awesome & curated list of best LLMOps tools for developers

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

FlashInfer: Kernel Library for LLM Serving

A visual playground for agentic workflows: Iterate over your agents 10x faster

Democratizing Reinforcement Learning for LLMs

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习｜数据合成

An Open Agent Computer for ANY digital work.

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

🐢 Open-Source Evaluation & Testing library for LLM Agents

A curated list of Artificial Intelligence Top Tools

The open source platform for AI-native application development.

MineContext is your proactive context-aware AI partner（Context-Engineering+ChatGPT Pulse）

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.

Superduper: End-to-end framework for building custom AI applications and agents.

Low-latency AI engine for mobile devices & wearables

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

A framework for efficient model inference with omni-modality models

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

TencentDB Agent Memory delivers fully local long-term memory for AI Agents via a 4-tier progressive pipeline, with zero external API dependencies.

HelixDB is an open-source graph-vector database built from scratch in Rust.

A curated list of vibe coding references, collaborating with AI to write code.

AG2 (formerly AutoGen): The Open-Source AgentOS. Join us at: https://discord.gg/sNGSwQME3x

The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.

Olares: An Open-Source Personal Cloud to Reclaim Your Data

A simple yet powerful agent framework that delivers with open-source models

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene.

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge