Bidirectional Encoder Representations from Transformers (BERT;<cite> Devlin et al., 2018)</cite> currently represents state of the art, vastly outperforming previous models, such as the Generative Pretrained Transformer (GPT; Radford et al.) and Embeddings from Language Models (ELMo; Peters et al., 2018) .