State-aware hedged requests for serverless GPU inference — return the first valid result and cancel the losers with an audited receipt.
What is the mireklzicar/gpuhedge GitHub project? Description: "State-aware hedged requests for serverless GPU inference — return the first valid result and cancel the losers with an audited receipt.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipReport bugs or request features on the gpuhedge issue tracker:
Open GitHub Issues