45 Forks
401 Stars
401 Watchers

torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

How to download and setup torchft

Open terminal and run command
git clone https://github.com/pytorch/torchft.git
git clone is used to create a copy or clone of torchft repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with torchft https://github.com/pytorch/torchft/archive/master.zip

Or simply clone torchft with SSH
[email protected]:pytorch/torchft.git

If you have some problems with torchft

You may open issue on torchft support forum (system) here: https://github.com/pytorch/torchft/issues

Similar to torchft repositories

Here you may see torchft alternatives and analogs

 etcd    nsq    Qix    dubbo    incubator-mxnet    tikv    hraftd    diplomat    js    elasticell    olric    translations    scalecube-services    finagle    neutrino    nanochain    mgmt    burry.sh    gosiris    dbtester    bit    rqlite    atomix    copycat    raft-rs    PySyncObj    floyd    raft    ra    x0