MegaFlux: Skew-Resilient MoE Megakernels via Pipelined Expert Replication
Preprint, 2026
Abstract
MegaFlux mitigates routing skew in mixture-of-experts megakernels through pipelined expert replication. An on-device planner places replicas and assigns work, while forward and backward execution overlap communication with computation.