BerriAI/litellm
GitHub
Releases1.44K
Frequency17 hours
Last Release
Stars51.6K
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Collections containing this project
Showing collections based on your access.
This project is not in any collections you can view.