Datasets. For the coarse-grained evaluation, we use the datasets containing human judgements as described earlier in Table REF  in Section . For the fine-grained evaluation, we use datasets containing multiple ground truth references which can then be perturbed using our templates. For MT, we use the expanded version of newstest2017 Chinese to English dataset [1]} which contains two references for each sentence. For QG, we use the SQuAD dataset [2]} which contains multiple questions for each passage. For AS, we use the curated personal narrative corpus [3]}. For DG, we use DailyDialog++ [4]} which contains two-speaker conversations on generic topics. For IC, we use the COCO component of the Composite dataset containing 5 reference captions for each image [5]}. Lastly, for D2T, we use the Triples-to-Text data of the WebNLG 2020 challenge dataset [6]}.
