llm-inference-benchmark
diegormirhan
Comparative benchmark of 4 LLM inference engines (HuggingFace, vLLM, AWQ, Speculative Decoding) on AMD GPU. Streamlit dashboard with real-time GPU telemetry, concurrent load testing, and throughput/latency visualization.
Growth over time
3 data points · 2026-08-09 → 2026-10-03How do you feel about this project?
Ask AI about llm-inference-benchmark
Question copied to clipboardWhat is the diegormirhan/llm-inference-benchmark GitHub project? Description: "Comparative benchmark of 4 LLM inference engines (HuggingFace, vLLM, AWQ, Speculative Decoding) on AMD GPU. Streamlit dashboard with real-time GPU telemetry, concurrent load testing, and throughput/latency visualization.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone llm-inference-benchmark
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipFound an issue?
Report bugs or request features on the llm-inference-benchmark issue tracker:
Open GitHub Issues