Topic

distributed-systems

Repositories (1586)

cursusdb
cursusdb cursusdb Go

CursusDB is an open-source distributed in-memory yet persisted document oriented database system with real time capabilities.

472
Tasqueue
Tasqueue kalbhor Go

A background jobs library for Go that allows pluggable brokers/store for distribution.

462
Gauntlet
Gauntlet Clivern

🔖 Guides, Articles, Podcasts, Videos and Notes to Build Reliable Large-Scale Distributed Systems.

460
adaptdl
adaptdl petuum Python

Resource-adaptive cluster scheduler for deep learning training.

459
rd-blender-docker
rd-blender-docker nytimes Python

A collection of Docker containers for running Blender headless or distributed ✨

455
dnpipes
dnpipes mhausenblas Go

Distributed Named Pipes

453
little-raft
little-raft andreev-io Rust

The lightest distributed consensus library. Run your own replicated state machine! ❤️

446
Awesome-Distributed-Deep-Learning
Awesome-Distributed-Deep-Learning bharathgs

A curated list of awesome Distributed Deep Learning resources.

442
Maze
Maze maze-agent Python

A distributed framework for LLM agents

438
cothority
cothority dedis Go

Scalable collective authority

433
testground
testground testground Go

🧪 A platform for testing, benchmarking, and simulating distributed and p2p systems at scale.

433
octopii
octopii octopii-rs Rust

🦑 Distributed Systems Kernel written in rust

433
raft
raft elixir-toniq Elixir

An Elixir implementation of the raft consensus protocol

431
PlatON-Go
PlatON-Go PlatONnetwork Go

Golang implementation of the PlatON protocol

426
waltz
waltz wepay Java

Waltz is a quorum-based distributed write-ahead log for replicating transactions

425
CloudI
CloudI CloudI Erlang

A Cloud at the lowest level!

424
coroutine
coroutine dispatchrun Go

Durable coroutines for Go

424
sparkler
sparkler USCDataScience Java

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

423
DAGSfM
DAGSfM AIBluefisher C

Distributed and Graph-based Structure from Motion. This project includes the official implementation of our Pattern Recognition 2020 paper: Graph-Base...

419
primehub
primehub myelintek Shell

open-source MLOps platform

410
dsync
dsync minio Go

A distributed sync package.

394
SUOD
SUOD yzhao062 Python

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

393
sleuth
sleuth ursiform Go

A Go library for master-less peer-to-peer autodiscovery and RPC between HTTP services

388
Pyro5
Pyro5 irmen Python

Pyro 5 - Python remote objects

382
crdt
crdt ljwagerfield

CRDT Tutorial for Beginners (a digestible explanation with less math!)

380
klein
klein shihuili1218 Java

🔥 Klein is a Paxos based distributed collection tool library, including distributed ArrayList, distributed HashMap, distributed Cache, distributed Lo...

379
sherlock
sherlock py-sherlock Python

Easy distributed locks for Python with a choice of backends.

377
Anubis
Anubis AnubisLMS Python

Distributed LMS for automating Computing Science Courses From NYU

376
delta-elixir
delta-elixir slab Elixir

Elixir implementation of Delta, the JSON format for describing rich-text content and their changes

374
diplomat
diplomat WeAreFarmGeek Ruby

A HTTP Ruby API for Consul

371
spawn
spawn eigr Elixir

Spawn - Actor Mesh

371
theta-protocol-ledger
theta-protocol-ledger thetatoken Go

Reference implementation of the Theta Blockchain Ledger Protocol

366
sentinel
sentinel aqstack Go

Self-healing edge computing agent with predictive failure detection and partition-resilient orchestration for Kubernetes

366
tifs
tifs Hexilee Rust

A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.

360
luacluster
luacluster surparallel C

MMO game server: Unity includes a 10,000 Player scene

360
distributed-java
distributed-java waylau

Distributed Java.《分布式 Java》

358
Thespian
Thespian thespianpy Python

Python Actor concurrency library

352
swim-rust
swim-rust graphform Rust

Self-contained distributed software platform for building stateful, massively real-time streaming applications in Rust.

350
CronHub
CronHub machanic Java

CronHub is a better crontab, it is a web application which can schedule, monitor and control the crontabs of multiple machines from the web page.

347
awesome-list-of-awesomes
awesome-list-of-awesomes Nachimak28

A curated list of all the Awesome --Topic Name-- lists I've found till date relevant to Data lifecycle, ML and DL.

345
areg-sdk
areg-sdk aregtech C++

Distributed C++ services from embedded to enterprise without rewrites

344
SCS
SCS innoq HTML

Self-Contained Systems

343
Arbore
Arbore MichaelMure JavaScript

Friend-to-friend filesharing app to save the world from dystopia

339
NoKV
NoKV feichai0017 Go

High-performance distributed KV storage based on LSM Tree

339
goakt
goakt Tochemey Go

[Go] Distributed Actor/Grain framework for Golang

338
blueprint
blueprint tangle-network Rust

A powerful toolkit for building distributed systems and infrastructure as code.

335
ReaLHF
ReaLHF openpsi-project Python

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

335
riteraft
riteraft PsiACE Rust

RiteRaft - A raft framework, for regular people

334
js
js gryadka JavaScript

Gryadka is a minimalistic master-master replicated consistent key-value storage based on the CASPaxos protocol

333
kubernetes-controller-sharding
kubernetes-controller-sharding timebertt Go

Horizontally Scalable Kubernetes Controllers: distribute reconciliation of Kubernetes objects across multiple controller instances

333