vllm-project

vllm-project

🏢 Organization

3 repositories on SrcLog

View on GitHub
3 Repos
101k Stars
24.2k Forks
670 Watchers

Repositories (3)

vllm vllm-project/vllm Python

A high-throughput and memory-efficient inference and serving engine for LLMs

93.1k
semantic-router vllm-project/semantic-router Go

An open, programmable decision layer for models and compute.

6.1k
vllm-metal vllm-project/vllm-metal Python

Community maintained hardware plugin for vLLM on Apple Silicon

1.8k