openweight-inference-api

openweight-inference-api

hec-ovi

ROCm-first OpenAI-compatible inference gateway for open-weight reasoning models. Single active profile (gpt-oss-20b, deepseek-r1-distill, qwen3-4b), host-mounted weights, fail-closed contract. FastAPI + vLLM.

2 Stars
0 Forks
0 Watchers
Python Language
mit License
24.1 SrcLog Score
Cost to Build
$5.0K
Market Value
$2.4K

Growth over time

7 data points  ·  2026-07-26 → 2026-11-13
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about openweight-inference-api

Question copied to clipboard

What is the hec-ovi/openweight-inference-api GitHub project? Description: "ROCm-first OpenAI-compatible inference gateway for open-weight reasoning models. Single active profile (gpt-oss-20b, deepseek-r1-distill, qwen3-4b), host-mounted weights, fail-closed contract. FastAPI + vLLM.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

🏆 Show off this rank

hec-ovi/openweight-inference-api on SrcLog (holo style)

Add it to a GitHub README or profile — the card updates as the ranking changes:

How to clone openweight-inference-api

Clone via HTTPS

git clone https://github.com/hec-ovi/openweight-inference-api.git

Clone via SSH

[email protected]:hec-ovi/openweight-inference-api.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the openweight-inference-api issue tracker:

Open GitHub Issues