The main goal of this work is to introduce a BERT-based entity similarity to capture latent entity type information which is supplementary to existing SOTA local context model <cite>(Ganea and Hofmann 2017)</cite> .