mosafariuk

mosafariuk

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
12 Stars
0 Forks
5 Watchers

🏆 Show off this rank

mosafariuk on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

Repositories (1)

TokenFlow-Gateway mosafariuk/TokenFlow-Gateway TypeScript

TokenFlow is an enterprise-grade, token-aware load balancer and AI gateway for vLLM. It prevents GPU OOM crashes using Redis-backed admission control, semantic caching, and dynamic token routing. Built in TypeScript for extreme bare-metal performance.

12