1 repository on SrcLog
Lightweight ROCm inference toolkit for AMD GPUs — FP16/INT8 quantization, batch processing, benchmarking, HuggingFace integration