Recently, there are many models leveraging BERT structure [1]}, [2]}, [3]}, [4]} and other unsupervised contextualized representations which generate impressive gains on coreference resolution tasks. Among them, some use BERT pretraining on passage-level sequences to more effectively model long-range dependencies [3]}, [2]}, some other models also adopt another SpanBERT representation [4]} focusing on pretraining span representations which also achieves outstanding performance on several benchmark datasets.
