ModelTC/LightLLM
GitHub
Releases3
Frequency3 months 1 week
Last Release
Stars4.09K
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Collections containing this project
Showing collections based on your access.
This project is not in any collections you can view.