To be comparable with the results reported by previous work on neural machine translation systems<cite> [22,</cite> 5, 2] , we train our models on the same training data of 12M parallel sentences (348M French and 304M English words).