BerriAI/litellm
GitHub
Releases1.42K
Frequency17 hours
Last Release
Stars49.3K
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Subscribe above to receive notifications when new versions are released.
| Version | Date | Stability Stability is determined by the version string and my be inaccurate. | |
|---|---|---|---|
| v1.77.7.rc.2 | RC | ||
| v1.77.7.rc.1 | RC | ||
| v1.77.7-nightly | Nightly | ||
| v1.77.5-stable | Stable | ||
| v1.77.1.rc.1-v2 | RC | ||
| v1.77.5.rc.4 | RC | ||
| v1.77.5.rc.3 | RC | ||
| v1.77.5.rc.2 | RC | ||
| v1.77.6.dev.1 | Development | ||
| v1.77.5.rc.1 | RC | ||
| v1.77.5-nightly | Nightly | ||
| v1.77.4-nightly | Nightly | ||
| v1.77.3-stable | Stable | ||
| v1.77.3.rc.1 | RC | ||
| v1.77.3-nightly | Nightly | ||
| v1.77.3.dynamic_rates | Unknown | ||
| v1.77.2-stable | Stable | ||
| v1.77.2.rc.2 | RC | ||
| v1.72.2.rc.2 | RC | ||
| v1.77.1.dev6 | Development | ||
| v1.77.1.dev5 | Development | ||
| v1.77.2.rc.1 | RC | ||
| v1.77.1-nightly | Nightly | ||
| v1.76.1.rc.3 | RC | ||
| v1.77.1.dev.2 | Development |