loxy-router

loxy-router

mageshkrishna

Warmth-aware load balancer and reverse proxy for self-hosted LLM inference — routes each request to the Ollama or vLLM backend that already has the model loaded

load-balancer
View on GitHub
3 Stars
0 Forks
0 Watchers
Go Language
other License
42.1 SrcLog Score
Cost to Build
$31.4K
Market Value
$22.2K
How is this calculated?

Growth over time

2 data points  ·  2026-07-26 → 2026-08-10
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about loxy-router

Question copied to clipboard

What is the mageshkrishna/loxy-router GitHub project? Description: "Warmth-aware load balancer and reverse proxy for self-hosted LLM inference — routes each request to the Ollama or vLLM backend that already has the model loaded". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone loxy-router

Clone via HTTPS

git clone https://github.com/mageshkrishna/loxy-router.git

Clone via SSH

[email protected]:mageshkrishna/loxy-router.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the loxy-router issue tracker:

Open GitHub Issues

Similar to loxy-router

pm2 traefik fabio armor nuster dpvs gobetween metallb roadrunner lura linkerd-tcp marathon-lb httpteleport multitor golb tempesta nixy dubbo3 styx awesome-nginx-security polaris-gslb slb portal sensu-plugins-aws KaHIP node-loadbalance Cekirdekler ansible-role-varnish docker-django-nginx-uwsgi-postgres-load-balance-tutorial tns