vllm-project/vllm
GitHub
Releases167
Frequency6 days 23 hours
Last Release
Stars83.5K
A high-throughput and memory-efficient inference and serving engine for LLMs
Collections containing this project
Showing collections based on your access.
This project is not in any collections you can view.