7 Forks
127 Stars
127 Watchers

FlexPrefill

Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference

How to download and setup FlexPrefill

Open terminal and run command
git clone https://github.com/ByteDance-Seed/FlexPrefill.git
git clone is used to create a copy or clone of FlexPrefill repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with FlexPrefill https://github.com/ByteDance-Seed/FlexPrefill/archive/master.zip

Or simply clone FlexPrefill with SSH
[email protected]:ByteDance-Seed/FlexPrefill.git

If you have some problems with FlexPrefill

You may open issue on FlexPrefill support forum (system) here: https://github.com/ByteDance-Seed/FlexPrefill/issues