The model follows the architecture of OpenAI GPT-2, and is trained (either from scratch or from OpenAI GPT-2) with 147M Reddit dialogues [1]}. We choose the model trained from OpenAI GPT-2 with 345M parameters, as it shows the best performance in the evaluation in [1]}. The model is implemented based on the code shared at https://github.com/microsoft/DialoGPT.
