1 repository on SrcLog
Add it to a GitHub README or profile β the card updates as the ranking changes:
Unofficial Python library implementing TurboQuant (Q_mse and Q_prod) KV cache compression for HuggingFace Transformers. One-line activate() API plus a CLI. Tested on Llama 3.1 and Qwen 2.5.