15 Forks
279 Stars
279 Watchers

extreme-bert

ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.

How to download and setup extreme-bert

Open terminal and run command
git clone https://github.com/extreme-bert/extreme-bert.git
git clone is used to create a copy or clone of extreme-bert repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with extreme-bert https://github.com/extreme-bert/extreme-bert/archive/master.zip

Or simply clone extreme-bert with SSH
[email protected]:extreme-bert/extreme-bert.git

If you have some problems with extreme-bert

You may open issue on extreme-bert support forum (system) here: https://github.com/extreme-bert/extreme-bert/issues