litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

rust

View on GitHub Website

53.9k Stars

9.9k Forks

216 Watchers

Python Language

other License

100 SrcLog Score

Cost to Build

$30.27M

Market Value

$236.32M

How is this calculated?

Growth over time

1 data points · 2026-07-17 → 2026-07-17

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about litellm

Question copied to clipboard

What is the BerriAI/litellm GitHub project? Description: "Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone litellm

Clone via HTTPS

git clone https://github.com/BerriAI/litellm.git

Clone via SSH

[email protected]:BerriAI/litellm.git

Download ZIP

Download litellm_internal_staging.zip

Found an issue?

Report bugs or request features on the litellm issue tracker:

Open GitHub Issues

Similar to litellm

rust servo alacritty redox awesome-rust fd awesomo gdbgui Rocket yew parity-ethereum exa compiler-explorer coreutils hyper tikv cargo rust-learning bat diesel mio tfs remacs piston book nom linkerd2 tokio geckodriver actix-web