vllm-project

vllm-project

🏢 Organization

2 repositories on SrcLog

View on GitHub
2 Repos
82k Stars
16.7k Forks
82k Watchers

Repositories (2)

vllm vllm-project/vllm Python

A high-throughput and memory-efficient inference and serving engine for LLMs

78.1k
semantic-router vllm-project/semantic-router Go

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

3.9k