@inproceedings{alduwais-etal-2024-cleananercorp,
    title = "{CLEANANERC}orp: Identifying and Correcting Incorrect Labels in the {ANER}corp Dataset",
    author = "AlDuwais, Mashael  and
      Al-Khalifa, Hend  and
      AlSalman, Abdulmalik",
    editor = "Al-Khalifa, Hend  and
      Darwish, Kareem  and
      Mubarak, Hamdy  and
      Ali, Mona  and
      Elsayed, Tamer",
    booktitle = "Proceedings of the 6th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT) with Shared Tasks on Arabic LLMs Hallucination and Dialect to MSA Machine Translation @ LREC-COLING 2024",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.osact-1.2",
    pages = "13--19",
    abstract = "Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label erros might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model performance. In this study, we dived deep into one of the widely adopted Arabic NER benchmark datasets (ANERcorp) and found a significant number of annotation errors, missing labels, and inconsistencies. Therefore, in this study, we conducted empirical research to understand these erros, correct them and propose a cleaner version of the dataset named CLEANANERCorp. CLEANANERCorp will serve the research community as a more accurate and consistent benchmark.",
}

Label errors are a common issue in machine learning datasets, particularly for tasks such as Named Entity Recognition. Such label erros might hurt model training, affect evaluation results, and lead to an inaccurate assessment of model performance. In this study, we dived deep into one of the widely adopted Arabic NER benchmark datasets (ANERcorp) and found a significant number of annotation errors, missing labels, and inconsistencies. Therefore, in this study, we conducted empirical research to understand these erros, correct them and propose a cleaner version of the dataset named CLEANANERCorp. CLEANANERCorp will serve the research community as a more accurate and consistent benchmark.
AlDuwais, Mashael Al-Khalifa, Hend AlSalman, Abdulmalik
CLEANANERCorp: Identifying and Correcting Incorrect Labels in the ANERcorp Dataset