In this paper, we have shown that the transfer learning method of <cite>Zoph et al. (2016)</cite> , while appealing, might not always work in a low-resource context. However, by combining it with BPE, we can improve NMT performance on a low-resource language pair by exploiting its lexical similarity with another related, low-resource language.