10 Forks
97 Stars
97 Watchers

willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

How to download and setup willow-inference-server

Open terminal and run command
git clone https://github.com/toverainc/willow-inference-server.git
git clone is used to create a copy or clone of willow-inference-server repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with willow-inference-server https://github.com/toverainc/willow-inference-server/archive/master.zip

Or simply clone willow-inference-server with SSH
[email protected]:toverainc/willow-inference-server.git

If you have some problems with willow-inference-server

You may open issue on willow-inference-server support forum (system) here: https://github.com/toverainc/willow-inference-server/issues