SivagurunathanV

L7 reverse proxy in Go that routes LLM requests by in-flight token count instead of connections. -12% P99 latency under contention.