49 Forks
701 Stars
701 Watchers

SqueezeLLM

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

How to download and setup SqueezeLLM

Open terminal and run command
git clone https://github.com/SqueezeAILab/SqueezeLLM.git
git clone is used to create a copy or clone of SqueezeLLM repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with SqueezeLLM https://github.com/SqueezeAILab/SqueezeLLM/archive/master.zip

Or simply clone SqueezeLLM with SSH
[email protected]:SqueezeAILab/SqueezeLLM.git

If you have some problems with SqueezeLLM

You may open issue on SqueezeLLM support forum (system) here: https://github.com/SqueezeAILab/SqueezeLLM/issues