186 Forks
2042 Stars
2042 Watchers

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

How to download and setup DeepSpeed-MII

Open terminal and run command
git clone https://github.com/deepspeedai/DeepSpeed-MII.git
git clone is used to create a copy or clone of DeepSpeed-MII repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with DeepSpeed-MII https://github.com/deepspeedai/DeepSpeed-MII/archive/master.zip

Or simply clone DeepSpeed-MII with SSH
[email protected]:deepspeedai/DeepSpeed-MII.git

If you have some problems with DeepSpeed-MII

You may open issue on DeepSpeed-MII support forum (system) here: https://github.com/deepspeedai/DeepSpeed-MII/issues