Most popular distributed-systems repositories and open source projects

advanced-java doocs Java

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服...

79.2k 19.1k 2.5k

redis redis C

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure serv...

77.5k 25.1k 2.5k

awesome-scalability binhnguyennus

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

75.7k 7.2k 1.9k

etcd etcd-io Go

Distributed reliable key-value store for the most critical data of a distributed system

52.6k 10.6k 1.3k

system-design karanpratapsingh

Learn how to design systems at scale and prepare for system design interviews

46.8k 6.1k 368

awesome-system-design-resources ashishps1 Java

Learn System Design concepts and prepare for interviews using free resources.

43.3k 9k 470

dubbo apache Java

The java implementation of Apache Dubbo. An RPC and microservice framework.

41.6k 26.3k 2.9k

spacedrive spacedriveapp Rust

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

39.5k 1.4k 226

seaweedfs seaweedfs Go

SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle b...

36k 3.1k 520

rustfs rustfs Rust

RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms...

35.9k 1.7k 91

anoma anoma Elixir

Reference implementation of Anoma

33.5k 4.1k 192

conductor conductor-oss Java

Conductor is an event driven agentic workflow engine providing durable and highly resilient execution engine for applications and AI Agents

32.5k 1.1k 48

system-design-academy systemdesign42

If you want to become good at AI engineering & system design, join this newsletter 👇

29.5k 3.9k 583

xgboost dmlc C++

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Had...

29k 9k 876

dapr dapr Go

Dapr is a portable runtime for building distributed applications across cloud and edge, combining event-driven architecture with workflow orchestratio...

26.2k 2.2k 395

nsq nsqio Go

A realtime distributed messaging platform

25.8k 2.9k 817

temporal temporalio Go

Temporal service

24.4k 2.1k 124

ddia Vonng Python

《Designing Data-Intensive Application》DDIA 第一版 / 第二版中文翻译

23.9k 4.6k 368

go-micro micro Go

A framework for agents, tools and services

23.1k 2.4k 480

nats-server nats-io Go

High-Performance server for NATS.io, the cloud and edge native messaging system.

21k 2k 379

bit teambit TypeScript

AI-powered development workspaces with reusable components, architectural clarity and zero overhead.

18.5k 963 162

rqlite rqlite Go

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

18k 827 217

incubator-mxnet apache C++

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go,...

17.3k 6.1k 17.3k

Qix ty4z2008

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

15.2k 4.6k 1.8k

juicefs juicedata Go

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

14.7k 1.4k 120

trino trinodb Java

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

13.5k 3.9k 178

akka-core akka Scala

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

13.3k 3.5k 544

zookeeper apache Java

Apache ZooKeeper

12.8k 7.3k 647

conductor Netflix Java

Conductor is a microservices orchestration engine.

12.8k 2.3k 143

encore encoredev Go

Infrastructure orchestration from local to your cloud

12.7k 656 65

awesome-system-design madd86

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

12.7k 1.4k 202

nebula vesoft-inc C++

A distributed, fast open-source graph database featuring horizontal scalability and high availability

12.5k 1.3k 186

awesome-distributed-systems theanalyst

A curated list to learn about distributed systems

12.4k 1.6k 424

micro micro Go

An API development platform

12.2k 1.1k 12.2k

quickwit quickwit-oss Rust

Cloud-native OSS search engine for observability

11.8k 628 69

talent-plan pingcap Rust

open source training courses about distributed database and distributed systems

11k 1.4k 243

orleans dotnet C#

Cloud Native application framework for .NET

10.9k 2.2k 465

git-bug git-bug Go

Distributed, offline-first bug tracker integrated in git

10.9k 347 76

petals bigscience-workshop Python

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

10.7k 656 110

cadence cadence-workflow Go

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalab...

9.6k 930 1.4k

FractalWorkspace Fractal-Compute-Orchestrations Python

A unified ecosystem and workspace for large-scale federated learning of Large Models & LLMS. Store compute as Wifi

9.2k 14 18

finagle twitter Scala

A fault tolerant, protocol-agnostic RPC system

8.9k 1.4k 534

docker-selenium SeleniumHQ Go

Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Container Platform, making it easier to perform browser automation at...

8.7k 2.5k 238