134 Forks
1939 Stars
1939 Watchers

distributed-llama

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

How to download and setup distributed-llama

Open terminal and run command
git clone https://github.com/b4rtaz/distributed-llama.git
git clone is used to create a copy or clone of distributed-llama repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with distributed-llama https://github.com/b4rtaz/distributed-llama/archive/master.zip

Or simply clone distributed-llama with SSH
[email protected]:b4rtaz/distributed-llama.git

If you have some problems with distributed-llama

You may open issue on distributed-llama support forum (system) here: https://github.com/b4rtaz/distributed-llama/issues