BerriAI/litellm
GitHub
Releases1.41K
Frequency17 hours
Last Release
Stars49.3K
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Subscribe above to receive notifications when new versions are released.
| Version | Date | Stability Stability is determined by the version string and my be inaccurate. | |
|---|---|---|---|
| v1.61.4-nightly | Nightly | ||
| v1.61.3.dev1 | Development | ||
| v1.61.3 | Stable | ||
| v1.61.3-nightly | Nightly | ||
| v1.61.2-nightly | Nightly | ||
| v1.61.1.dev5 | Development | ||
| v1.61.1.dev1 | Development | ||
| v1.61.1 | Stable | ||
| v1.61.1.dev2 | Development | ||
| v1.61.0 | Stable | ||
| v1.61.0.dev1 | Development | ||
| v1.60.8 | Stable | ||
| v1.60.4-stable | Stable | ||
| v1.60.6 | Stable | ||
| v1.60.5 | Stable | ||
| v1.60.5-dev1 | Development | ||
| v1.60.4 | Stable | ||
| v1.60.2-dev1 | Development | ||
| v1.60.2 | Stable | ||
| v1.60.0.dev4 | Development | ||
| v1.60.0.dev2 | Development | ||
| v1.60.0.dev1 | Development | ||
| v1.60.0 | Stable | ||
| v1.59.10 | Stable | ||
| v1.59.8-stable | Stable |