22 Forks
174 Stars
174 Watchers

LLM-Drop

The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".

How to download and setup LLM-Drop

Open terminal and run command
git clone https://github.com/CASE-Lab-UMD/LLM-Drop.git
git clone is used to create a copy or clone of LLM-Drop repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with LLM-Drop https://github.com/CASE-Lab-UMD/LLM-Drop/archive/master.zip

Or simply clone LLM-Drop with SSH
[email protected]:CASE-Lab-UMD/LLM-Drop.git

If you have some problems with LLM-Drop

You may open issue on LLM-Drop support forum (system) here: https://github.com/CASE-Lab-UMD/LLM-Drop/issues