Moreover, BERT+G&Hs embeddings performs significantly worse than the baseline <cite>(Ganea and Hofmann 2017)</cite> and our proposed BERT-Entity-Sim model. The reason is that BERT-based context representation space and <cite>Ganea and Hofmanns entity embeddings space</cite> are heterogeneous. <cite>Ganea and Hofmanns entity embeddings</cite> are bootstrapped from word embeddings which mainly capture topic level entity relatedness, while BERT-based context representation is derived from BERT which naturally captures type information.