We extend our metric for evaluating manual or automatic redundant annotations, like the Dense dataset or <cite>the parser</cite> in (<cite>Fitzgerald et al., 2018</cite>) , which predicts argument spans independently of each other.