Empirically, both Sutskever et al.<cite> [22]</cite> and Bahdanau et al. [2] have observed that sentences with many rare words tend to be translated much more poorly than sentences containing mainly frequent words.