llm-d

llm-d

🏢 Organization

2 repositories on SrcLog

View on GitHub
2 Repos
4.2k Stars
946 Forks
91 Watchers

Repositories (2)

llm-d llm-d/llm-d Shell

Achieve state of the art inference performance with modern accelerators on Kubernetes

4k
llm-d-router llm-d/llm-d-router Go

llm-d Router: The intelligent entry point for inference requests

277