litellm-rs

litellm-rs

majiayu000

Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

streaming
View on GitHub Website
121 Stars
18 Forks
2 Watchers
Rust Language
mit License
100 SrcLog Score
Cost to Build
$1.60M
Market Value
$5.05M
How is this calculated?

Growth over time

5 data points  ·  2026-07-25 → 2026-10-24
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about litellm-rs

Question copied to clipboard

What is the majiayu000/litellm-rs GitHub project? Description: "Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.". Written in Rust. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

🏆 Show off this rank

majiayu000/litellm-rs on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

How to clone litellm-rs

Clone via HTTPS

git clone https://github.com/majiayu000/litellm-rs.git

Clone via SSH

[email protected]:majiayu000/litellm-rs.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the litellm-rs issue tracker:

Open GitHub Issues

Similar to litellm-rs

webtorrent FFmpeg logstash mediaelement webtorrent-desktop hls.js awesome-developer-streams butter-desktop jocko tribler streamlink torrent pushpin instant.io onyx red5-server streamlink-twitch-gui bt scio HaishinKit.swift Aerial eventql lua-resty-http Mobius smart_open PandoraPlayer akka-http AthenaX Popcorn nginx-vod-module