The primary purpose of an AutoRegressive language model is to predict the next word based on the preceding words. This is commonly known as left-to-right language modelling, where the token at the current time t is predicted based on the first t-1 tokens.