llama-qwen

llama.cpp + Qwen3.6-27B (Q8_0 GGUF) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). 256K context, ~7.5 t/s decode via TheRock ROCm Docker.

amd

View on GitHub

7 Stars

0 Forks

0 Watchers

Python Language

unlicense License

54.1 SrcLog Score

Cost to Build

$920

Market Value

$840

How is this calculated?

Growth over time

1 data points · 2026-07-26 → 2026-07-26

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about llama-qwen

Question copied to clipboard

What is the hec-ovi/llama-qwen GitHub project? Description: "llama.cpp + Qwen3.6-27B (Q8_0 GGUF) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). 256K context, ~7.5 t/s decode via TheRock ROCm Docker.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone llama-qwen

Clone via HTTPS

git clone https://github.com/hec-ovi/llama-qwen.git

Clone via SSH

[email protected]:hec-ovi/llama-qwen.git

Download ZIP

Download main.zip

Found an issue?

Report bugs or request features on the llama-qwen issue tracker:

Open GitHub Issues

Similar to llama-qwen

webpack madge steal wufuc conditioner awesome-vulkan esl zydis staxrip pyopencl coriander lodjs easytimer.js ocl angular-async-loader node-dependency-tree purge-wrangler require-vuejs GatelessGateSharp SimpleSvm set-egpu parenchyma node-precinct TypeScript-AMD-Boilerplate ScanTree awesome-d3d12 Tensile generator-module-boilerplate akase romania-choropleth