89 Forks
1928 Stars
1928 Watchers

OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK.

How to download and setup OnnxStream

Open terminal and run command
git clone https://github.com/vitoplantamura/OnnxStream.git
git clone is used to create a copy or clone of OnnxStream repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with OnnxStream https://github.com/vitoplantamura/OnnxStream/archive/master.zip

Or simply clone OnnxStream with SSH
[email protected]:vitoplantamura/OnnxStream.git

If you have some problems with OnnxStream

You may open issue on OnnxStream support forum (system) here: https://github.com/vitoplantamura/OnnxStream/issues