1 repository on SrcLog
Add it to a GitHub README or profile β the card updates as the ranking changes:
Engine-agnostic, state-aware gateway for LLM inference: an OpenAI/Anthropic-compatible router + an optional vLLM plugin + a pluggable state layer for KV-cache-aware and latency-aware routing.