distributed-llm-inference-platform

jiholee5217

Fault-tolerant distributed LLM serving with a Go control plane, Python workers, gRPC, and Raft-backed state.

raft

View on GitHub

0 Stars

0 Forks

0 Watchers

Go Language

mit License

30 SrcLog Score

Cost to Build

$1.8K

Market Value

$500

How is this calculated?

Growth over time

1 data points · 2026-08-18 → 2026-08-18

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about distributed-llm-inference-platform

Question copied to clipboard

What is the jiholee5217/distributed-llm-inference-platform GitHub project? Description: "Fault-tolerant distributed LLM serving with a Go control plane, Python workers, gRPC, and Raft-backed state.". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone distributed-llm-inference-platform

Clone via HTTPS

git clone https://github.com/jiholee5217/distributed-llm-inference-platform.git

Clone via SSH

[email protected]:jiholee5217/distributed-llm-inference-platform.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the distributed-llm-inference-platform issue tracker:

Open GitHub Issues

Similar to distributed-llm-inference-platform

etcd rqlite tikv patroni atomix raft-zh_cn summitdb braft logcabin awesome-consensus tidis hraftd raft.github.io copycat finn raft-rs PySyncObj dissertation distributed-computing elasticell Mushroom permazen raftos raft-java floyd raft xenon ra x0 verdi-raft