_Remark 9.1_ (topk).: Result 9 holds even in the "sparsest" setting where \(topk=1\) and \(cap\_factor=2\) in the MoE routing. The results are similar when using \(topk=2\) and \(cap\_factor=1\) or \(topk=2\) and \(cap\_factor=2\)-- we discuss more in Appendix D.