The inter-annotator agreement was computed using Cohen’s quadratic weighted \(\kappa \)  [1]}. The obtained rates were 0.24, 0.25 and 0.75 for grammaticality, meaning preservation and structural simplicity, respectively. System scores were calculated by averaging over the annotators' scores and the 300 sentences.
<TABLE>