region:us
The CoNLL-2012 shared task involved predicting coreference in English, Chinese, and Arabic, using the final version, v5.0,
of the OntoNotes corpus. It was a follow-on to the English-only task organized in 2011. Until the creation of the OntoNotes
corpus, resources in this sub-field of language processing were limited to noun phrase coreference, often on a restricted
set of entities, such as the ACE entities. OntoNotes provides a large-scale corpus of general anaphoric coreference not
restricted to noun phrases or to a specified set of entity types, and covers multiple languages. OntoNotes also provides
additional layers of integrated annotation, capturing additional shallow semantic structure. This paper describes the
OntoNotes annotation (coreference and other layers) and then describes the parameters of the shared task including the
format, pre-processing information, evaluation criteria, and presents and discusses the results achieved by the participating
systems. The task of coreference has had a complex evaluation history. Potentially many evaluation conditions, have, in the past,
made it difficult to judge the improvement in new algorithms over previously reported results. Having a standard test set
and standard evaluation parameters, all based on a resource that provides multiple integrated annotation layers (syntactic
parses, semantic roles, word senses, named entities and coreference) and in multiple languages could support joint modeling
and help ground and energize ongoing research in the task of entity and event coreference.
For more details see https://aclanthology.org/W12-4501.pdf
@inproceedings{pradhan2012conll,
  title={CoNLL-2012 shared task: Modeling multilingual unrestricted coreference in OntoNotes},
  author={Pradhan, Sameer and Moschitti, Alessandro and Xue, Nianwen and Uryupina, Olga and Zhang, Yuchen},
  booktitle={Joint Conference on EMNLP and CoNLL-Shared Task},
  pages={1--40},
  year={2012}
}
Entry not found