To verify the contribution of our proposed BERT-based entity embeddings, we also compare with a straightforward baseline which directly replaces the encoder of <cite>Ganea and Hofmann (2017)</cite> utilizing pre-trained BERT. To do so, we introduce a 768 × 300 dimensional matrix W which projects BERT-based context representation c into <cite>Ganea and Hofmann (2017)</cite>'s entity embeddings space when calculating the similarity score.