37 Forks
365 Stars
365 Watchers

torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

How to download and setup torchft

Open terminal and run command
git clone https://github.com/pytorch/torchft.git
git clone is used to create a copy or clone of torchft repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with torchft https://github.com/pytorch/torchft/archive/master.zip

Or simply clone torchft with SSH
[email protected]:pytorch/torchft.git

If you have some problems with torchft

You may open issue on torchft support forum (system) here: https://github.com/pytorch/torchft/issues