STACKQUADRANT

bentoml/OpenLLM

Inference Engines

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

GitHub Metrics
Stars
12.1k
Forks
799
Open Issues
12
Watchers
58
Contributors
32
Weekly Commits
0
Language
Python
License
Apache-2.0
Last Commit
Mar 2, 2026
Created
Apr 19, 2023
Latest Release
v0.6.30
Release Date
Apr 21, 2025
Synced: Mar 3, 2026
Quality Scores
Documentation Qualityw: 20%
0.0
Community Healthw: 20%
0.0
Maintenance Velocityw: 15%
0.0
API Design & DXw: 20%
0.0
Production Readinessw: 15%
0.0
Ecosystem Integrationw: 10%
0.0
Tags
bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-ops
Radar
No scores yet