Model Serving
Platforms for deploying and serving ML/AI models at scale
mosecorg/mosec
6.6
★ 904◇ 75Python
pipeless-ai/pipeless
5.0
★ 855◇ 53Rust
bentoml/Yatai
5.7
★ 839◇ 75TypeScript
ServerlessLLM/ServerlessLLM
5.6
★ 718◇ 83Python
kossisoroyce/timber
4.9
★ 690◇ 23Python
eightBEC/fastapi-ml-skeleton
4.3
★ 601◇ 92Python
underneathall/pinferencia
4.7
★ 541◇ 83Python
ome-projects/ome
6.2
★ 525◇ 106Go
AI-Hypercomputer/JetStream
4.6
★ 473◇ 70Python
intel/xFasterTransformer
4.9
★ 435◇ 74C++
NVIDIA/gpu-rest-engine
3.7
★ 420◇ 95C++
Lightning-Universe/stable-diffusion-deploy
4.6
★ 391◇ 38Python
Epistates/pmetal
5.2
★ 332◇ 27Rust
containers/podman-desktop-extension-ai-lab
5.8
★ 302◇ 85TypeScript
raketenkater/ggrun
4.7
★ 284◇ 18Go
raketenkater/llm-server
4.7
★ 284◇ 18Go
BMW-InnovationLab/BMW-YOLOv4-Inference-API-GPU
4.1
★ 275◇ 68Python
BMW-InnovationLab/BMW-YOLOv4-Inference-API-CPU
3.9
★ 217◇ 59Python
← prev2 / 2