We compare THUMT with the state-of-the-art opensource toolkit GroundHog<cite> (Bahdanau et al., 2015)</cite> and achieve significant improvements on ChineseEnglish translation tasks by introducing new training criteria and optimizers.