MegaFlux: Skew-Resilient MoE Megakernels via Pipelined Expert Replication

Jianzhu Yao

Siva Kumar Sastry Hari

Vignesh Balaji

Sana Damani

Insu Jang

Pramod Viswanath

Christos Kozyrakis Stanford

Preprint, 2026


Abstract

MegaFlux mitigates routing skew in mixture-of-experts megakernels through pipelined expert replication. An on-device planner places replicas and assigns work, while forward and backward execution overlap communication with computation.