GSQHalo.cpp
Aristo94/GSQHalo.cpp
C++
llama.cpp fork for GSQ-quantized Qwen3.8-Flash-Next on AMD Strix Halo (gfx1151): faster ROCm prefill, MTP and 4Γ256K chats with Q8_0 KV and one KV stream per slot, persistent KV cache on SSD. Fork of halo-box/strix-llama.cpp.