Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine
What is the BrunoArsioli/llama-optimus GitHub project? Description: "Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine ". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipReport bugs or request features on the llama-optimus issue tracker:
Open GitHub Issues