BerriAI/litellm
GitHub
Releases1.41K
Frequency17 hours
Last Release
Stars49.3K
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Subscribe above to receive notifications when new versions are released.
| Version | Date | Stability Stability is determined by the version string and my be inaccurate. | |
|---|---|---|---|
| v1.69.0.dev1 | Development | ||
| v1.69.1-nightly | Nightly | ||
| v1.69.0-stable | Stable | ||
| v1.69.0-nightly | Nightly | ||
| v1.68.2.dev6 | Development | ||
| v1.68.2-nightly | Nightly | ||
| v1.68.1.dev4 | Development | ||
| v1.68.1.dev2 | Development | ||
| v1.68.1.dev1 | Development | ||
| v1.68.1-nightly | Nightly | ||
| v1.68.0-nightly | Nightly | ||
| v1.68.0-stable | Stable | ||
| v1.67.7-stable | Stable | ||
| v1.67.6.dev1 | Development | ||
| v1.67.6-nightly | Nightly | ||
| v1.67.5-nightly | Nightly | ||
| v1.67.4-stable | Stable | ||
| v1.67.4-nightly | Nightly | ||
| v1.67.3.dev6 | Development | ||
| v1.67.3.dev4 | Development | ||
| v1.67.3.dev1 | Development | ||
| v1.67.2-nightly | Nightly | ||
| v1.67.1-nightly | Nightly | ||
| v1.67.0-stable | Stable | ||
| v1.67.0-nightly | Nightly |