Most popular distributed-systems repositories and open source projects

httping-docker BretFisher C

Ping with HTTP requests, built directly from master

56 18 56

Data-pipeline-project hiejulia Jupyter Notebook

Data pipeline project

56 28 56

ank sunary Python

Python data pipeline

56 3 56

kraken kraken-hpc Go

Kraken is a distributed state engine framework for scalable automation and orchestration tools.

55 15 55

open-stream-processing-benchmark Klarrio Jupyter Notebook

This repository contains the code base for the Open Stream Processing Benchmark.

55 15 55

rce rcenvironment

Distributed, workflow-driven integration environment

55 17 55

Distributed-Algorithms aQuaYi Go

利用 Go 语言实现多种分布式算法

55 7 55

indra indra-labs Go

Distributed Virtual Private Network Powered By Bitcoin Lightning

54 2 54

learning-distributed-systems arsh

List to all papers, books, blogs, articles, repos that I come across while studying distributed systems.

54 9 54

fast_retraining Azure Jupyter Notebook

Show how to perform fast retraining with LightGBM in different business cases

54 13 54

ps_pytorch hwang595 Python

implement distributed machine learning with Pytorch + OpenMPI

53 15 53

southpaw jwplayer Java

:baseball: Streaming left joins in Kafka for change data capture

53 9 53

Distributed-System-Algorithms-Implementation shwetayakkali Java

Algorithms for implementation of Clock Synchronization, Consistency, Mutual Exclusion, Leader Election

53 14 53

hlclock elixir-toniq Elixir

Hybrid Logical Clocks for Elixir

53 3 53

chemtrail jrasell Go

Chemtrail is a client scaler for HashiCorp Nomad allowing for dynamic and safe scaling of the client workerpool based on demand.

52 2 52

orderlyid orderlykit Go

OrderlyID — Typed, time-sortable 160-bit identifiers with optional checksum, tenant, and shard fields. Safer than UUIDv4, more ergonomic than ULID/Typ...

52 1 52

NErlNet leondavi Python

Nerlnet is a framework for research and development of distributed machine learning models on IoT

52 9 52

thecrowler pzaino Go

A Content Discovery and Development Platform. Empowering Cybersecurity, AI, Marketing, and Finance professionals and researchers to discover, analyze,...

52 11 52

dpwa loudinthecloud Python

Distributed Learning by Pair-Wise Averaging

52 6 52

nkn-client-js nknorg JavaScript

[Deprecated, use nkn-sdk-js instead] JavaScript implementation of NKN client

52 18 52

DistributedStorage-Notes wx-chevalier HTML

分布式存储系列：分布式 ID，分布式文件系统，复制，对象存储，区块链

51 9 51

akka-typed-session rkuhn Scala

add-on to Akka Typed that tracks effects for use with Session Types

51 7 51

aten rabbitmq Erlang

An adaptive accrual node failure detection library for Elixir and Erlang

51 14 51

neo C4T-BuT-S4D Go

Exploit distribution system for A&D competitions

51 7 51

eZAutoML eZWALT Python

A Democratized, lightweight and modern framework for Python Automated Machine Learning

51 2 51

ego Tochemey Go

[Go]Minimal event sourcing/CQRS library using protocol buffers for commands, events and states.

51 5 51

DSPy-Multi-Document-Agents jmanhype Python

An advanced distributed knowledge fabric for intelligent document processing, featuring multi-document agents, optimized query handling, and semantic...

51 6 51

Robot-Formation-Control LorenzoBalandi Python

Formation control for a multi-agent system in a bidimensional space. Various types of formations available. Implementation in ROS2 Foxy.

51 6 51

rate wallstreetcn Go

Golang rate limiter for distributed system

50 13 50

regatta jamf Go

Regatta is a distributed key-value store. It is Kubernetes friendly with emphasis on high read throughput and low operational cost.

50 3 50

distributed-dev-learning evasnowind Java

汇总、整理常用的分布式开发技术，给出demo，方便学习。包括数据分片、共识算法、一致性hash、分布式事务、非侵入的分布式链路追踪实现原理等内容。

50 19 50

flame xflops Rust

A distributed system for Agentic AI

50 12 50

retry-go rafaeljesus Go

Retrying made simple and easy for golang :repeat:

50 6 50

Jetmaker gavinwei121 Python

An easy Python framework to build distributed systems

50 3 50

rejot rejot-dev TypeScript

Supercharged Replication for Developers

50 1 50

PiKV NoakLiu Python

PiKV: KV Cache Management System for Mixture of Experts [Efficient ML System]

49 6 49

Python-backend-knowledge-base nightblure

Knowledge base for python backend developers

48 4 48

mnevis rabbitmq Erlang

Raft-based, consensus oriented implementation of Mnesia transactions

48 9 48

nestjs-temporal-core harsh-simform TypeScript

NestJS integration for Temporal.io with Worker and Client support

48 10 48

Ollama-Workbench marc-shade Python

A comprehensive platform for managing, testing, and leveraging Ollama AI models with advanced features for customization, workflow automation, and col...

48 8 48

research taoshengshi

distributed system;blokchain;filecoin/ipfs,...

48 13 48

sdk-java restatedev Java

Restate SDK for JVM Languages

48 14 48

books wangzhe3224

48 18 48

jeesuite-config vakinge Java

简约而不简单功能强大的配置中心。部署简单、支持多环境多版本配置管理。支持全局配置、多应用共享配置、配置加密、配置实时同步、spring/springboot无缝对接，...

48 32 48

bridgefour chollinger93 Scala

Bridge Four is a simple, functional, effectful, single-leader, multi worker, distributed compute system optimized for embarrassingly parallel workload...

47 9 47