hipfire × KVMem —— 把 KVMem 的分页/分层 KV 移植进 hipfire 这个 RDNA 原生 Rust 引擎,让 262144 上下文在 24 GB 显卡上跑起来;agent 负载实测中位 32 tok/s。Paged/tiered KV (KVMem) ported into the RDNA-native Rust engine hipfire.
What is the A-ENTROPY/hipfire-kvmem GitHub project? Description: "hipfire × KVMem —— 把 KVMem 的分页/分层 KV 移植进 hipfire 这个 RDNA 原生 Rust 引擎,让 262144 上下文在 24 GB 显卡上跑起来;agent 负载实测中位 32 tok/s。Paged/tiered KV (KVMem) ported into the RDNA-native Rust engine hipfire.". Written in C++. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipReport bugs or request features on the hipfire-kvmem issue tracker:
Open GitHub Issues