WayInfer

NextTokens

Run LLMs larger than your RAM — native GGUF inference engine with SSD streaming, no GPU required

runtime

View on GitHub

3 Stars

1 Forks

1 Watchers

C Language

mit License

43.1 SrcLog Score

Cost to Build

$4.4K

Market Value

$3.3K

How is this calculated?

Growth over time

2 data points · 2026-08-31 → 2026-09-26

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about WayInfer

Question copied to clipboard

What is the NextTokens/WayInfer GitHub project? Description: "Run LLMs larger than your RAM — native GGUF inference engine with SSD streaming, no GPU required". Written in C. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone WayInfer

Clone via HTTPS

git clone https://github.com/NextTokens/WayInfer.git

Clone via SSH

[email protected]:NextTokens/WayInfer.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the WayInfer issue tracker:

Open GitHub Issues

Similar to WayInfer

node coreclr napajs ChakraCore mono iOSProject awesome-compilers ts-node Colorful aesthetic nexusjs ObjectiveKit io-ts ringojs spirit c2goasm Harmony druntime RuntimePermission Reflection RaftLib reflow go-runtime-metrics enforce PH7 runq Runtime ErlangRT MessageThrottle runtypes