International Arab Conference on Information Technology ACIT 2016 Word Boundary Detection in Tifinagh using MaxEnt and n gram algorithms
This article proposes the use of Maximum Entropy and n gram algorithms for the automatic segmentation of words in Tifinagh.The Maximum Entropy algorithm is a probability distribution widely used for a variety of natural language processing tasks, such as sentence boundary detection, part of speech, etc.The maximum entropy formulation has a unique solution that can be found by the Generalized Iterative Scaling algorithm.Our experimental results show that the model of maximum entropy using the approach based character considerably improves the quality of the segmentation of words in Tifinagh.