Michael-A-Kuykendall/shimmy
GitHub
Releases39
Frequency1 week 2 hours
Last Release
Stars5.32K
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Subscribe above to receive notifications when new versions are released.