Open WebUI with a custom proxy for RunPod-hosted GGUF language models. It allows you to run models like Gemma or Mistral on RunPod and interact with them through Open WebUI using an OpenAI-compatible interface. The proxy translates OpenAI chat requests into RunPod job submissions and streams responses back to the client.
What is the MarvInt64/openwebui-runpod-proxy-and-worker GitHub project? Description: "Open WebUI with a custom proxy for RunPod-hosted GGUF language models. It allows you to run models like Gemma or Mistral on RunPod and interact with them through Open WebUI using an OpenAI-compatible interface. The proxy translates OpenAI chat requests into RunPod job submissions and streams responses back to the client. ". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipReport bugs or request features on the openwebui-runpod-proxy-and-worker issue tracker:
Open GitHub Issues