loxilb-inference-gateway

loxilb-io

Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb

load-balancer

View on GitHub

6 Stars

1 Forks

0 Watchers

Go Language

apache-2.0 License

69.8 SrcLog Score

Cost to Build

$2.86M

Market Value

$3.42M

How is this calculated?

Growth over time

2 data points · 2026-09-07 → 2026-10-03

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about loxilb-inference-gateway

Question copied to clipboard

What is the loxilb-io/loxilb-inference-gateway GitHub project? Description: "Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb". Written in Go. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone loxilb-inference-gateway

Clone via HTTPS

git clone https://github.com/loxilb-io/loxilb-inference-gateway.git

Clone via SSH

[email protected]:loxilb-io/loxilb-inference-gateway.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the loxilb-inference-gateway issue tracker:

Open GitHub Issues

Similar to loxilb-inference-gateway

pm2 traefik fabio armor nuster dpvs gobetween metallb roadrunner lura linkerd-tcp marathon-lb httpteleport multitor golb tempesta nixy dubbo3 styx awesome-nginx-security polaris-gslb slb portal sensu-plugins-aws KaHIP node-loadbalance Cekirdekler ansible-role-varnish docker-django-nginx-uwsgi-postgres-load-balance-tutorial tns