diegormirhan

diegormirhan

👤 Developer

1 repository on SrcLog

View on GitHub
1 Repos
2 Stars
0 Forks
0 Watchers

Repositories (1)

llm-inference-benchmark diegormirhan/llm-inference-benchmark Python

Comparative benchmark of 4 LLM inference engines (HuggingFace, vLLM, AWQ, Speculative Decoding) on AMD GPU. Streamlit dashboard with real-time GPU telemetry, concurrent load testing, and throughput/latency visualization.

2