Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)