Neural models have consistently shown top performance in shared evaluation tasks (Bojar et al., 2016; Cettolo et al., 2016) and are becoming the technology of choice for commercial MT service providers<cite> (Wu et al., 2016</cite>; Crego et al., 2016) .