We note that in<cite> (Huang et al., 2012</cite> ) the similarity between two word-context pairs is the measured using avgSimC, a weighted average of cosine similarities between all possible representation vectors of w 1 and w 2 . This metric, however, can not be applied to our approach since we have an infinite number of possible contextual representation for each word.