Semantic Enhanced Training Data Augmentation Methods for Long Tail Entity Recognition Models
Named Entity Recognition (NER) is an essential information retrieval task. It enables a wide range of natural language processing applications such as semantic search, machine translation, etc. The NER can be formulated as the task of identifying and typing words or phrases in a text that refers to certain classes of interest (e.g. disease, Adverse Drug Reactions) There are different techniques to tackle NER, such as dictionary based, rulebased, and machine learning based. Machine learning based NER techniques have shown to perform the best for entities with large amounts of human labeled training datasets. However, their performance is limited when dealing with long tail entities. Long tail entities are entities that have a low frequency in the document collections and usually have no reference to existing Knowledge Bases. Obtaining human labeled datasets is expensive and time consuming, especially for long tail entities that are scarcely available in document collections. This dissertation focuses on the problem of the lack of training data, arguably the largest bottleneck in training machine learning based NER techniques. We investigated efficient and effective ways to augment training data by enhancing their size and quality automatically. Our work aimed at showing how, by enhancing the size and quality of the training data using different techniques, it will be possible to improve the performance of Long tail Entity Recognition (L tER)