horovod
                                Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
                            
                        How to download and setup horovod
Open terminal and run command
                                            git clone https://github.com/horovod/horovod.git
                                        
                                        git clone is used to create a copy or clone of horovod repositories.
                                        You pass git clone a repository URL. it supports a few different network protocols and corresponding URL formats.
Also you may download zip file with horovod https://github.com/horovod/horovod/archive/master.zip
Or simply clone horovod with SSH
                                            [email protected]:horovod/horovod.git                                    
                                    If you have some problems with horovod
You may open issue on horovod support forum (system) here: https://github.com/horovod/horovod/issuesSimilar to horovod repositories
Here you may see horovod alternatives and analogs
gold-miner tensorflow keras scikit-learn TensorFlow-Examples pytorch face_recognition CNTK data-science-ipython-notebooks Qix handong1587.github.io telegram-list netdata mlcourse.ai stats Winds machine-learning-curriculum caffe tesseract machine-learning-for-software-engineers awesome-deep-learning-papers incubator-mxnet lectures cs-video-courses julia Screenshot-to-code spaCy cheatsheets-ai awesome-deep-learning python-machine-learning-book