Releases138
Frequency1 week 15 hours
Last Release
Stars9.33K
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

CVE History

CVEPublishedCVSS v3CVSS v2
5.5 MEDIUM5.2 MEDIUM

A vulnerability, which was classified as critical, has been found in Xorbits Inference up to 1.4.1. This issue affects the function load of the file xinference/thirdparty/cosyvoice/cli/model.py. The manipulation leads to deserialization.