The simple inter-annotator agreement 5 was 67% for annotator A%B, 51% for A&C and 44% for A&D. These agreement figures are higher than the figures in <cite>Bonial et al. (2014)</cite> , and actual agreement is probably even higher, because synonymous rolesets are regarded as disagreements.