kvcache-ai/ktransformers

kvcache-ai/ktransformers

Releases34
Frequency2 weeks 5 days
Last Release
Stars17.2K
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Subscribe above to receive notifications when new versions are released.
VersionDate
Stability
Stability is determined by the version string and my be inaccurate.
v0.2.2rc1 RC
v0.2.1.post1 Unknown
v0.2.1 Stable
v0.2.0 Stable
v0.1.4 Stable
v0.1.3 Stable
v0.1.2 Stable
v0.1.1 Stable
v0.1.0 Stable