Topic

distributed

Repositories (1529)

Raft-Paxos-Sample
Raft-Paxos-Sample liu-jianhao Go

MIT6.824实现分布式一致性算法——Raft&Paxos

47
scaling-to-distributed-crawling
scaling-to-distributed-crawling ZenRows HTML

Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.

46
EasyParallelLibrary
EasyParallelLibrary alibaba Python

Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed giant model training.

46
mero
mero AdRoll Erlang

scalable and lightweight OTP Erlang client for memcached

46
GoGetit
GoGetit Superego-CodeEngineer Go

Go学习+面试通关, 覆盖Go程序员需要掌握的所有基础知识

46
propulate
propulate Helmholtz-AI-Energy Python

Propulate is an asynchronous population-based optimization algorithm and software package for global optimization and hyperparameter search on high-pe...

46
healthcare.js
healthcare.js goldfire JavaScript

Distributed DigitalOcean droplet auto-healing built on top of democracy.js.

45
eventd
eventd sardemff7 C

A simple daemon to track remote or local events and do actions the user wants to

45
scrapy-kafka-redis
scrapy-kafka-redis tenlee2012 Python

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

45
awesome-distributed-computing-projects
awesome-distributed-computing-projects en3r0

This is a list of Free Software which contribute resources to a distributed network.

45
nostrp2p
nostrp2p ryogrid Go

Pure Peer-to-Peer Distributed Microblogging System on NAT Transparent Overlay Network

45
dhaf
dhaf hyperion-cs C#

Distributed high availability failover, written in cross-platform C# .NET (Linux, Windows and macOS supported).

44
siahub
siahub SiaHubLab PHP

SiaHub - Siacoin network monitoring system

44
ros-kubernetes
ros-kubernetes diegoferigo Dockerfile

A minimal setup to run a simple publisher-subscriber ROS application in a kubernetes cluster

44
gop2p
gop2p lucasmenendez Go

Simple Peer-to-Peer protocol implementation in pure Go. Uses HTTP client and server to communicate over internet to knowed network members.

44
raftify
raftify lablup Rust

Experimental High level Raft framework

44
crdt
crdt cblp Haskell
44
r4ml
r4ml CODAIT R

Scalable R for Machine Learning

43
spark-connect-rust
spark-connect-rust apache Python

Apache Spark Connect Client for Rust (Rust core + Python wrapper)

43
coaty-js
coaty-js coatyio TypeScript

Collaborative IoT framework in JavaScript/TypeScript for Node.js and browsers.

43
yesquel
yesquel mkaguilera C++

Yesquel: scalable SQL storage for Web apps

43
datafusion-ballista-python
datafusion-ballista-python apache Shell

Apache Arrow Ballista Python bindings

42
zebra
zebra tietang Go

a dynamic gateway for golang,支持Eureka、k8s、consul

41
Distributed-Systems-Guide
Distributed-Systems-Guide mikeroyal

Distributed Systems Guide

40
ansible-role-linux-prometheus
ansible-role-linux-prometheus goldstrike77 Jinja

Ansible role for install and configure standalone or distributed Prometheus v2 with long term storage capabilities on Linux operating system.

40
WaspsWithBazookas
WaspsWithBazookas Phara0h Rust

Its like bees with machine guns but way more power

40
EfficientDDP-4-Contrastive-Train
EfficientDDP-4-Contrastive-Train zsnoob Python

Optimizing the way of contrastive learning in PyTorch-DDP(DistributedDataParallel) multi-GPU training

40
quckoo
quckoo alonsodomin Scala

Fault tolerant distributed task scheduler.

40
lorhammer
lorhammer itkSource Go

Stress your lora network-server - mirror of https://gitlab.com/itk.fr/lorhammer

40
Federated-Lifelong-Person-ReID
Federated-Lifelong-Person-ReID MSNLAB Python

FedSTIL: Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges. (TCSVT'23)

39
kafka-python-camera-stream
kafka-python-camera-stream akmamun Python

Distributed Streaming with Apache Kafka and Python OpenCV

39
crypto-dht
crypto-dht Champii Vue

Blockchain over DHT in GO

39
blobit
blobit diennea Java

BlobIt - a Distributed Large Object Storage

39
blazingcache
blazingcache diennea Java

Blazing Fast Distributed Cache

39
zuliasearch
zuliasearch zuliaio Java

Zulia Search Engine

38
traffic
traffic graphform TypeScript

Massively real-time traffic streaming application

38
systemds
systemds tugraz-isds Java

An open source ML system for the end-to-end data science lifecycle

38
parle
parle ucla-vision Python
38
PeARS-orchard
PeARS-orchard PeARSearch HTML

This is the development version of PeARS, the people's search engine. More compact but less robust than PeARS-federated. If you just want to use PeARS...

38
gocorex
gocorex qingwave Go

Gocorex is a collection golang useful utils for golang application, distributed system and microservices.

37
drasyl
drasyl drasyl Java

drasyl-java is a high-performance framework for rapid development of distributed applications

37
neofs-node
neofs-node nspcc-dev Go

NeoFS is a decentralized distributed object storage integrated with the Neo blockchain

37
ddal
ddal hellojavaer Java

DDAL(Distributed Data Access Layer) is a simple solution to access database shard.

37
portal
portal danijar Python

Fast and reliable distributed systems in Python

36
twemproxy-163
twemproxy-163 helifu C

twemproxy-163 supports redis-server failover by communicating with redis-sentinel

36
distributed-services-with-go-workshop
distributed-services-with-go-workshop igor-baiborodine Go

This workshop covers material from the "Distributed Services with Go" book.

36
oxen-storage-server
oxen-storage-server oxen-io C++

Storage server for Oxen Service Nodes

36
canary
canary znx3p0 Rust

Distributed systems library for making communications through the network easier, while keeping minimalism and flexibility.

36
y-react
y-react joebobmiles TypeScript

React bindings for Yjs.

36
distributed-systems-papers
distributed-systems-papers ycd

An opinionated must read papers on Distributed Systems

36