phuongncn

phuongncn

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
1 Stars
0 Forks
1 Watchers

Repositories (1)

llama-ready phuongncn/llama-ready Python

A smart Layer-7 Auto-Scaler & Lifecycle Proxy for llama.cpp. Save 100% VRAM when idle, auto-spawn multiple instances on demand, and prevent AI Agent bottlenecks with zero-config.

1