32 Forks
262 Stars
262 Watchers

mixture-of-experts

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

How to download and setup mixture-of-experts

Open terminal and run command
git clone https://github.com/lucidrains/mixture-of-experts.git
git clone is used to create a copy or clone of mixture-of-experts repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with mixture-of-experts https://github.com/lucidrains/mixture-of-experts/archive/master.zip

Or simply clone mixture-of-experts with SSH
[email protected]:lucidrains/mixture-of-experts.git

If you have some problems with mixture-of-experts

You may open issue on mixture-of-experts support forum (system) here: https://github.com/lucidrains/mixture-of-experts/issues