A note to be considered, is that the lists we used in our experiments (and obtained from<cite> Bolukbasi et al. (2016)</cite> and Gonen and Goldberg (2019) ) may contain words that are missing in our corpus and so we can not obtain contextualized embeddings for them.