1 repository on SrcLog
Add it to a GitHub README or profile β the card updates as the ranking changes:
Frequency-based KV cache pruning for llama.cpp β 25% cache reduction, improved PPL at long context. GPU compaction kernel for HIP/ROCm.