ModelTC/LightLLM

ModelTC/LightLLM

Releases3
Frequency3 months 1 week
Last Release
Stars4.09K
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Subscribe above to receive notifications when new versions are released.
VersionDate
Stability
Stability is determined by the version string and my be inaccurate.
v1.1.0 Stable
v1.0.1 Stable
v1.0.0 Stable