akinauphill

akinauphill

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
2 Stars
0 Forks
0 Watchers

🏆 Show off this rank

akinauphill on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

Repositories (1)

vulkan-moe-streaming akinauphill/vulkan-moe-streaming Shell

Run MoE models several times bigger than your RAM on a gaming PC with an AMD/Vulkan GPU: llama.cpp patch that streams experts from NVMe with a RAM cache and a VRAM hot-expert tier (~2x faster generation, ~7x faster prompts).

2