Our language model is based on the GPT-2, similar to that in [1]}. We borrowed pretrained GPT-2 and PPLM models and their implementations from HuggingFace https://huggingface.co/. In their implementation, GPT-2 is GPT-2 medium.
