Ternary LLMs on llama.cpp, any GPU — run a 27B model in 5.5–6.7 GB. Prebuilt Linux/Windows binaries, Vulkan and CUDA, OpenAI-compatible API.
What is the ftoleedo/dartai GitHub project? Description: "Ternary LLMs on llama.cpp, any GPU — run a 27B model in 5.5–6.7 GB. Prebuilt Linux/Windows binaries, Vulkan and CUDA, OpenAI-compatible API.". Written in Shell. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Add it to a GitHub README or profile — the card updates as the ranking changes:
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipReport bugs or request features on the dartai issue tracker:
Open GitHub Issues