Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies