AadhilFarhan

AadhilFarhan

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
1 Stars
0 Forks
1 Watchers

Repositories (1)

kvrouter AadhilFarhan/kvrouter Go

KV-cache-aware inference router for self-hosted LLM pools. Envoy ext_proc Endpoint Picker + standalone proxy, in Go.

1