Exact FlashAttention for AMD RDNA2 (gfx1030 / RX 6800 XT), written in HIP. Drop-in replacement for flash-attn: 19.8 TFLOP/s forward, decode at 99% of HBM bandwidth.
What is the 2kiss/flash-attention-rdna2 GitHub project? Description: "Exact FlashAttention for AMD RDNA2 (gfx1030 / RX 6800 XT), written in HIP. Drop-in replacement for flash-attn: 19.8 TFLOP/s forward, decode at 99% of HBM bandwidth.". Written in HIP. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipReport bugs or request features on the flash-attention-rdna2 issue tracker:
Open GitHub Issues