rocm-inference-toolkit

rocm-inference-toolkit

lemesbesti7

Lightweight ROCm inference toolkit for AMD GPUs — FP16/INT8 quantization, batch processing, benchmarking, HuggingFace integration

amd
View on GitHub
0 Stars
0 Forks
0 Watchers
Python Language
mit License
18 SrcLog Score
Cost to Build
$500
Market Value
$500
How is this calculated?

Growth over time

1 data points  ·  2026-08-09 → 2026-08-09
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about rocm-inference-toolkit

Question copied to clipboard

What is the lemesbesti7/rocm-inference-toolkit GitHub project? Description: "Lightweight ROCm inference toolkit for AMD GPUs — FP16/INT8 quantization, batch processing, benchmarking, HuggingFace integration". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone rocm-inference-toolkit

Clone via HTTPS

git clone https://github.com/lemesbesti7/rocm-inference-toolkit.git

Clone via SSH

[email protected]:lemesbesti7/rocm-inference-toolkit.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the rocm-inference-toolkit issue tracker:

Open GitHub Issues

Similar to rocm-inference-toolkit

webpack madge steal wufuc conditioner awesome-vulkan esl zydis staxrip pyopencl coriander lodjs easytimer.js ocl angular-async-loader node-dependency-tree purge-wrangler require-vuejs GatelessGateSharp SimpleSvm set-egpu parenchyma node-precinct TypeScript-AMD-Boilerplate ScanTree awesome-d3d12 Tensile generator-module-boilerplate akase romania-choropleth