The HyTER metric <cite>(Dreyer and Marcu, 2012 )</cite> relies on massive reference networks encoding an exponential number of correct translations for parts of a given sentence, proposed by human annotators. <cite>HyTER</cite> spurred a lot of enthusiasm but the need for human annotations heavily reduced its applicability to new data.