Here, we describe briefly the underlying framework, called RNN Encoder-Decoder, proposed by<cite> (Cho et al., 2014b)</cite> and (Sutskever et al., 2014) upon which we build a machine transliteration model that learns to transliterate end-to-end.