We list six inconsistent configurations in literature, which lead to difficulties for fair comparison. Some literature reports results using mean and standard deviation under different random seeds (Chiu and Nichols, 2016; Peters et al., 2017; Liu et al., 2018) . Others report the best result among different trials (<cite>Ma and Hovy, 2016</cite>) , which cannot be compared directly.