vllm

vllm

Python Package IndexPython Package Index
PyPIpypi.org
Releases89
Frequency1 week 5 days
Last Release
A high-throughput and memory-efficient inference and serving engine for LLMs
Log in to subscribe

Linked projects

vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs