We report results with Bleu (mteval-v13a.pl),
and chrF3 [1]}, a character n-gram F\(_3\)  score which was found to correlate well with human judgments, especially for translations out of English [2]}. Since our main claim is concerned with the translation of rare and unseen words, we report separate statistics for these.
We measure these through unigram F\(_1\) , which we calculate as the harmonic mean of clipped unigram precision and recall.Clipped unigram precision is essentially 1-gram BLEU without brevity penalty.
