jundot

👤 Developer

1 repository on SrcLog

1 Repos

23.4k Stars

2.1k Forks

115 Watchers

Add it to a GitHub README or profile — the card updates as the ranking changes:

Repositories (1)

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar