2. The LEA evaluation metric [1]} should be used as the primary performance indicator for cdevcr. This metric was previously shown to be more discriminative than previous coreference resolution metrics such as CoNLL F1, in particular by taking size differences between clusters into account. We showed that cluster sizes in cdevcr corpora vary significantly and observed score deltas between CoNLL F1 and LEA F1 of up to 20 pp. which clearly motivates its use for cdevcr over CoNLL F1.
