26 Forks
380 Stars
380 Watchers

Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

How to download and setup Sophia

Open terminal and run command
git clone https://github.com/kyegomez/Sophia.git
git clone is used to create a copy or clone of Sophia repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with Sophia https://github.com/kyegomez/Sophia/archive/master.zip

Or simply clone Sophia with SSH
[email protected]:kyegomez/Sophia.git

If you have some problems with Sophia

You may open issue on Sophia support forum (system) here: https://github.com/kyegomez/Sophia/issues