MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies