1 repository on SrcLog
Distributed inference infrastructure for Mixture-of-Experts models. Run large MoE models on consumer GPUs.