Overall, our rare word translation model interpolates between the SOTA system and the system of Sutskever et al.<cite> [22]</cite> , which allows us to outperform SOTA on sentences that consist predominantly of frequent words and approach its performance on sentences with many OOV words.