18 Forks
491 Stars
491 Watchers

native-sparse-attention-pytorch

Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper

How to download and setup native-sparse-attention-pytorch

Open terminal and run command
git clone https://github.com/lucidrains/native-sparse-attention-pytorch.git
git clone is used to create a copy or clone of native-sparse-attention-pytorch repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with native-sparse-attention-pytorch https://github.com/lucidrains/native-sparse-attention-pytorch/archive/master.zip

Or simply clone native-sparse-attention-pytorch with SSH
[email protected]:lucidrains/native-sparse-attention-pytorch.git

If you have some problems with native-sparse-attention-pytorch

You may open issue on native-sparse-attention-pytorch support forum (system) here: https://github.com/lucidrains/native-sparse-attention-pytorch/issues