Releases89
Frequency1 week 5 days
Last Release
A high-throughput and memory-efficient inference and serving engine for LLMs
Collections containing this project
Showing collections based on your access.
This project is not in any collections you can view.