1 repository on SrcLog
Add it to a GitHub README or profile β the card updates as the ranking changes:
Ternary LLMs on llama.cpp, any GPU β run a 27B model in 5.5β6.7 GB. Prebuilt Linux/Windows binaries, Vulkan and CUDA, OpenAI-compatible API.