32 Forks
313 Stars
313 Watchers

KIVI

[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

How to download and setup KIVI

Open terminal and run command
git clone https://github.com/jy-yuan/KIVI.git
git clone is used to create a copy or clone of KIVI repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with KIVI https://github.com/jy-yuan/KIVI/archive/master.zip

Or simply clone KIVI with SSH
[email protected]:jy-yuan/KIVI.git

If you have some problems with KIVI

You may open issue on KIVI support forum (system) here: https://github.com/jy-yuan/KIVI/issues