llama.cpp — a leading open-source project in the AI/LLM ecosystem.
vLLM — a leading open-source project in the AI/LLM ecosystem.