Most popular distributed-systems repositories and open source projects

Tasqueue

A background jobs library for Go that allows pluggable brokers/store f...

24   430   430  

cothority

Scalable collective authority

104   428   428  

testground

🧪 A platform for testing, benchmarking, and simulating distributed an...

74   428   428  

waltz

Waltz is a quorum-based distributed write-ahead log for replicating tr...

34   426   426  

PlatON-Go

Golang implementation of the PlatON protocol

155   423   423  

coroutine

Durable coroutines for Go

13   421   421  

CloudI

A Cloud at the lowest level!

50   420   420  

DAGSfM

Distributed and Graph-based Structure from Motion. This project includ...

90   420   420  

sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

141   418   418  

primehub

open-source MLOps platform

42   408   408  

torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

45   401   401  

dsync

A distributed sync package.

42   398   398  

SUOD

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Hetero...

49   391   391  

sleuth

A Go library for master-less peer-to-peer autodiscovery and RPC betwee...

24   383   383  

klein

🔥 Klein is a Paxos based distributed collection tool library, includi...

24   378   378  

sherlock

Easy distributed locks for Python with a choice of backends.

35   377   377  

delta-elixir

Elixir implementation of Delta, the JSON format for describing rich-te...

14   372   372  

diplomat

A HTTP Ruby API for Consul

116   371   371  

theta-protocol-ledger

Reference implementation of the Theta Blockchain Ledger Protocol

87   367   367  

Pyro5

Pyro 5 - Python remote objects

39   363   363  

tifs

A distributed POSIX filesystem based on TiKV, with partition tolerance...

23   363   363  

distributed-java

Distributed Java.《分布式 Java》

104   359   359  

luacluster

MMO game server: Unity includes a 10,000 Player scene

76   358   358  

crdt

CRDT Tutorial for Beginners (a digestible explanation with less math!)

14   355   355  

swim-rust

Self-contained distributed software platform for building stateful, ma...

11   350   350  

awesome-list-of-awesomes

A curated list of all the Awesome --Topic Name-- lists I've found till...

47   341   341  

Thespian

Python Actor concurrency library

68   341   341  

Arbore

Friend-to-friend filesharing app to save the world from dystopia

50   341   341  

CronHub

CronHub is a better crontab, it is a web application which can schedul...

148   341   341  

SCS

Self-Contained Systems

32   338   338  

spawn

Spawn - Actor Mesh

13   335   335  

js

Gryadka is a minimalistic master-master replicated consistent key-valu...

31   333   333  

riteraft

RiteRaft - A raft framework, for regular people

23   329   329  

timecraft

The WebAssembly Time Machine

7   328   328  

Hydra

Hydra九头龙，面向PB级别知识库取数、情报系统、数据平台、大规模控制调度...

23   326   326  

blueprint

A powerful toolkit for building distributed systems and infrastructure...

9   326   326  

neoq

Queue-agnostic background job library for Go, with a pleasant API and...

5   320   320  

Zebus

A lightweight Peer to Peer Service Bus

63   317   317  

Anubis

Distributed LMS for automating Computing Science Courses From NYU

50   315   315  

chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference wi...

80   315   315  

ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

20   315   315  

MIT-6.824-Distributed-Systems

2018年春季课程学习资料汇总

74   310   310  

areg-sdk

Areg SDK — the network operator for C++ programs: automates RPC, IPC,...

126   301   301  

KungFu

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch...

59   298   298  

crdt-playground

20   296   296  

kubernetes-controller-sharding

Horizontally Scalable Kubernetes Controllers: distribute reconciliatio...

8   295   295  

moogle

My very own search engine

21   294   294  

erleans

Erlang Orleans

27   294   294  

tractor

distributed structured concurrency

12   292   292  

HyperTrade

Ready to deploy, distributed cryptocurrency trading bot

68   291   291