Dialog generation, in particular lengthy dialogue, is a challenging task. This is due to the necessity of not only ensuring that the language model possesses natural language processing capabilities, but also that the model is able to utilise context in order to satisfy the requirements of the dialogue.