Topic

distributed-systems

Repositories (1670)

torchft
torchft meta-pytorch Python

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

539
distributed-ml-patterns
distributed-ml-patterns terrytangyuan Python

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

539
elasticell
elasticell deepfabric Go

Elastic Key-Value Storage With Strong Consistency and Reliability

529
swim
swim graphform Java

Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs

496
package
package metaparticle-io Go

Metaparticle/Package: Language Fluent Containerization and Deployment in Java, .NET and Javascript (and more coming soon)

491
NoKV
NoKV NoKV-Lab Rust

The State Layer of Agent Sandbox

489
distributed-systems-technologies-and-cases-analysis
distributed-systems-technologies-and-cases-analysis waylau

《分布式系统常用技术及案例分析》示例源码

488
nkn
nkn nknorg Go

Official Go implementation of NKN full node.

486
odin
odin theycallmemac Go

A programmable, observable and distributed job orchestration system.

483
DistributedSystemNotes
DistributedSystemNotes ChrisWhealy

Notes on Lindsey Kuper's lectures on Distributed Systems

483
cursusdb
cursusdb cursusdb Go

CursusDB is an open-source distributed in-memory yet persisted document oriented database system with real time capabilities.

471
Tasqueue
Tasqueue kalbhor Go

A background jobs library for Go that allows pluggable brokers/store for distribution.

464
Gauntlet
Gauntlet Clivern

🔖 Guides, Articles, Podcasts, Videos and Notes to Build Reliable Large-Scale Distributed Systems.

461
adaptdl
adaptdl petuum Python

Resource-adaptive cluster scheduler for deep learning training.

459
rd-blender-docker
rd-blender-docker nytimes Python

A collection of Docker containers for running Blender headless or distributed ✨

459
dnpipes
dnpipes mhausenblas Go

Distributed Named Pipes

452
octopii
octopii octopii-rs Rust

🦑 Distributed Systems Kernel written in rust

451
little-raft
little-raft andreev-io Rust

The lightest distributed consensus library. Run your own replicated state machine! ❤️

450
Awesome-Distributed-Deep-Learning
Awesome-Distributed-Deep-Learning bharathgs

A curated list of awesome Distributed Deep Learning resources.

442
Puppetmaster
Puppetmaster professorpalmer Python

Provider-neutral control plane for durable-state agent swarms: subprocess workers, leases, artifacts, memory, and deterministic stitching.

439
horus
horus softmata Rust

Fastest Robotics Runtime System. If phones have Android, robots deserve HORUS.

439
testground
testground testground Go

🧪 A platform for testing, benchmarking, and simulating distributed and p2p systems at scale.

436
raft
raft elixir-toniq Elixir

An Elixir implementation of the raft consensus protocol

434
cothority
cothority dedis Go

Scalable collective authority

430
PlatON-Go
PlatON-Go PlatONnetwork Go

Golang implementation of the PlatON protocol

426
waltz
waltz wepay Java

Waltz is a quorum-based distributed write-ahead log for replicating transactions

424
CloudI
CloudI CloudI Erlang

A Cloud at the lowest level!

423
DAGSfM
DAGSfM AIBluefisher C

Distributed and Graph-based Structure from Motion. This project includes the official implementation of our Pattern Recognition 2020 paper: Graph-Base...

423
coroutine
coroutine dispatchrun Go

Durable coroutines for Go

422
sparkler
sparkler USCDataScience Java

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

419
primehub
primehub myelintek Shell

open-source MLOps platform

409
SUOD
SUOD yzhao062 Python

(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)

395
crdt
crdt ljwagerfield

CRDT Tutorial for Beginners (a digestible explanation with less math!)

395
dsync
dsync minio Go

A distributed sync package.

393
Hydra
Hydra DragonKingpin Java

为超级个体和一个人公司打造一个人的大厂,Hydra九头龙构筑大规模AI调度、数据采集、情报系统、数据平台、分析决策、产品生产的'军事'工业基座。

393
sleuth
sleuth ursiform Go

A Go library for master-less peer-to-peer autodiscovery and RPC between HTTP services

387
Pyro5
Pyro5 irmen Python

Pyro 5 - Python remote objects

387
goakt
goakt Tochemey Go

[Go]Distributed Actor/Grain framework for Golang with goodies

385
namastack-outbox
namastack-outbox namastack Kotlin

Outbox Implementation for Spring Boot

384
Anubis
Anubis AnubisLMS Python

Distributed LMS for automating Computing Science Courses From NYU

381
spawn
spawn eigr Elixir

Spawn - Actor Mesh

378
sherlock
sherlock py-sherlock Python

Easy distributed locks for Python with a choice of backends.

376
delta-elixir
delta-elixir slab Elixir

Elixir implementation of Delta, the JSON format for describing rich-text content and their changes

376
cppGFS2.0
cppGFS2.0 Gan-Tu C++

A distributed Google File System (GFS), partially implemented in C++. (http://bit.ly/gfs-impl)

375
diplomat
diplomat WeAreFarmGeek Ruby

A HTTP Ruby API for Consul

372
sentinel
sentinel aqstack Go

Self-healing edge computing agent with predictive failure detection and partition-resilient orchestration for Kubernetes

366
areg-sdk
areg-sdk aregtech C++

Distributed C++ services from embedded to enterprise

366
theta-protocol-ledger
theta-protocol-ledger thetatoken Go

Reference implementation of the Theta Blockchain Ledger Protocol

365
luacluster
luacluster surparallel C

MMO game server: Unity includes a 10,000 Player scene

363
tifs
tifs Hexilee Rust

A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.

362