Agreeing on what is the most appropriate RST relation, as expected, is difficult with its large relation taxonomy: Krippendorff's \(\alpha \)  (with MASI distance to account for multiple selection) between the two annotators is 0.216, indicating only fair agreement [1]}. To study the effects of seeing the QUD, we further asked the annotators to find a relation without the question.We paced 3 months between annotation with and without the question to minimize memorization effects. This led to a much lower, 0.158 \(\alpha \)  value.
Thus the presence of the QUD could, in some cases, align divergent opinions, as in the following example:
