1 repository on SrcLog
Add it to a GitHub README or profile β the card updates as the ranking changes:
KV-cache-aware inference router for self-hosted LLM pools. Envoy ext_proc Endpoint Picker + standalone proxy, in Go.